OOCOHBIT BBSOIB 



OD 017 295 



Hctaaghtln, Donald B. 

Title I, 1965-1975; Synthesis of the findings of 
Federal Studies. 

Aaerican Institutes for Research in the Behavioral 
Sciences, Palo Alto, Calif. 

Rational Inst, of Bducition (DHEi) , iashington, 
D.C. 

IIB-61700-7/77-FR-1 

Jul 77 \ 

106p.; For related docnients see OD 917 296 and OD 
017 297 ; Contains soae saall type 

HP-$0.83 BC-$6.01 Plus Postage. 
*Cospensatory Education; *Educational Policy; 
^EzalJiation: 'Evaluatioa Ret hods; Failure Factors; 
Federal Prograss; Prograc Descriptions; ♦Progras 
Effectiveness; ♦Besearq^h Utilization; *Succes» 
Factors 

*Elesentary Secondary Education Act Title I 



This report focuses on the results of approjtiaately 
twenty central studies of coipensatory education completed before 
1977 and presents the lajor results of thbse studies ai^ they relate 
to ipportant policy questions for Title I of the Bleientary and 
Secondary Education Act. The results arf presented first as they ^ 
relate to the lajor tasks of Title I; participant selection, 
treatment delivery, and evaluation lepacting. Then the results 
concerning prograi effectiveness are reviewed; overall effectiveness, 
variation in effectiveness as a function of treatment aethod, and 
variation in effectiveness across types of participants. Finally, a 
series of eight aajor probleas in the iapleaentation of coapensatory 
education are identified and discussed. The inforaation on overall 
prograa effectiveness, as aeasored in teras of increased a.chieveaent 
gains by prograa participants, has been less than adequate to 
deteraine the effectiveness of the prograa. Concerning variation in 
•ffectiveoess aaong treataent aethods, the data also leave rDoa for 
iethodological iaproveaent. Concerning yariation in effectiveness 
across population groups, little inforaation is reported. The aajor 
probleas listed for Title I include aisnse of funds, lack-^of 
consistent federal regulations and guidelines, invaUd evaluations, 
lack of parental involveaent, lack cf affective treataent lethods, 
lack of knowledge about individual differences in the processes by 
which children acquire cognitive skills, and the exclusion of 
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: to Its 010 

aoteoB 
tirtB 

i 
t- 

IffSTITOTIOl 

SPOBS ,A6UICT 

BSPOBT BO 
POi DATE 
BOTE 

ft 

BDBS PBICE 
DBSCBIPTOBS 

IDBBTIFIEBS 
ABSTRACT 



Documents acquired by ERIC include many informal unpubUshed materials not av^able from other sources. ERIC makes every 
effort to obtain the best copy available. Nevertheless, items of marginal reproducibiUty are often encountered and this affects the 
quality of the microfiche and hardcopy reproductions ERIC makes available via the ERIC Document Reproduction Service (EDRS). 
O 5 is not responsible for the quality of the original document Renroductions suppUed*y EDRS are the best tl.at cm be made from 



SCOfC0FlNTEM«TN0TlCI 

,hif<*>cum««)of n-ai*""* 

,,.l„otinw«t to « 
potnts o< vl«W' 



TITl4)B 1, 10611-197^: 
FINDINGS OF FEDERAL STUDIES 



Donald H. McLaughlin 



July 1977 



U»01^A*TMlNT0l|HtAtTH. 

tOUCATlOM AW1L^A«« 
MATlWALIMlTlTUTf 
■OUCATION 

EDUCATION WStT.ON OR POLICY 




KINS 



S FOR BESHIlRCH 



Box Ills / Pflo Alto, Calif orni*' »480S 

2 



4^. : 



Preface ^ 

Title* I of the Elementary and Second^ary Educatlqn Act of 1965 has been 
In op^ation for slightly sore than a decade. During that period, thousands 
of docuaents have been written about It, so an ^dc-rtane step In deciding on 
the c<yt«it of this synthesis was the choice of what small portion of the 
r^evant literature to focus attention upon, within the temporal and budget- 
ary constraints of this effort. The project monitor for the* National Insti- 
tute of Education, Alison Wolf, and the author Jointly decided \ipon a 
set of fifteen major federal studies to be assimilated into this synthesis, 
along with other relevant sources that intruded into the author *s conscious- 
ness. Those fifteen studies are described by Robert J. Rossi and his 
colleaguea in a companion document. We l)elleve that these documents contain 
much of what is known about compensatory education; however, this syntheses 
cam^; substitute for a thorough review of the erperlaj|[tal research liter- 
ature on educational illsadvantage. 

The Initial draft of this synthesis was begun in Hay, 1977, after. the 
fifteen najor studies had been sugnarlzed and about a dozen methodological 
Issues tiad been discussed in companion documents. Kev.ln Gl^rtln, on the 
staff of the American Institutes for Research, made valuable coieaeAts and 
suggestions during the development of that draft. In early June, 1977, the 
draft was. reviewed by Alison, Wblf , Joy Frechtllfig, and Marjorle Kulash, of 
HIB, by George Mayeske, of the Office of Planning, Budgeting, and Evaluation 
In the U.S. Office of Education, and by Al Chalupslcy, of AIR. Again, in 
producing the present draft, in July, 1977, Kevin Gllmartl-i has provided 

esscntdLal connents, along with editorial Improvements. 

«> 

Emily Campbell and Joan Hansen were very helpful in producing a final 
typed versldn of the manuscript that was not only more legible but also 
more understaiidable than what they were given. 1 am very grateful to them, 
to the reviewers, who made very useful conmenta, and to jay wife, who grace- 
fully accepted the Implications of •'.he temporal and budgetary constraints of 
this project. Of course, the reaponslbillty for any errors in the final 
contents of this synthesis is mine flone. 

• ' Donald H. McLaughllit 
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TITLE I, 1965-1975; ' . . 

A SYNTHESIS OF TW FlJlDINCS OF FEDERAL STUDIES * 

^ ^ » Introduction 

Ai )i complenent to Its gathering of new Information on the i&ethods and 
effectiveness of compensatory education as mandaced by Congress (P«L« 93-380 » 
Section 8^1), the National Institute of Education contracted with, the Amerl- 
emi Institutes for Research to produce a sumoiary -and synthesis of the sub- 
stantive and methodological results of previous fedcfral evaluations of com- 
pensatory education. This and two companion Ti^ports constitute that syn- 
thesis. The other two documents are Siinnarles of Federal Studies of Comperi^ 

> 

satory Education (Rosst, ilcLaughlln, CampKell, and Everett, 1977), pontalnlng 
a 5- to 10-page stinmary of each of 15 major studies, and Centroversles In the 
Evaluation of Compensatory Education (McLaughlin, Gilmartln^ and Rossi, 1977), 
containing discussions of ten majjor methodological Issues. The aim of this 
document Is to present the consensus of the major studies' results In terms 
of policy-related questions. At the out^t of the task. It was expected 
that a major portion of the effort would Involve the reconciliation of con- 
flicting resui.ts of different but apparently valid a tudlecf*^ however, this 
turned out not to be a substantial problem. For most Issues, the. major pro- 
blem was to draw any valid substantive conclusions from any of the studies. 
Nearly universally, the authors of the evaluation reports pointed out serious 
profalesB with their studies that limited their conclusions, and there were 
other problems not pointed out that^uld have been. These are discussed In 
the companion report on methodological Issues. In spite of the methodologi- 
cal proble^, this document Is written for the reader who needs and Is willing 
to settle for at least the partial answers to policy-related questions that 
can be obtained ^rgm the studies. ^ 

In order to select a reasonable format for presenting the m;^ny details 
learned about the^federal compensatory education progx^am through the evalu- 
ation studies. It is necessary first to consider the. system referred to here 
as "Title I". Historically, the first major federal effort to provide 4ld 
to the elementary and secondary schools In the country was the Elemientary ' 
Secondary Education Act (ESEA) of 1965* Title I of that law, Its major 
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..U<m«nt, authorized approxilbatax $1 biUion to be spent each yea r to mee t ^ ' 
th« .pecial educational needs of- educfttionalV disadvantaged children in 
loir-incowi areas.- Betv-eeu 1965 and 1975, thi authorization rose to an 
annual level of $4.4 billion, although appro^riatiO|s rose only lo $1.9 ' ^ 

billion in that period... Title I was last amended 4n .1-974 to produce incre- 
l^tal-lnproveinents in its operation; and consideration by Confess of major 
revisions is Ukely to precede its potential reauthorization in 1978. 

The' Title I system, if It cak be called a system with its diffuse 
boundaries, ^s extremely complex.and can best , be understood by starting vlth^ 
a simple, .idealistic image and showing how adaptations to problems have tDsde 
it nl^re com^rex. The idealistic model .is present^n figure 1. According ^ 
to that model, through the joint efforts of parents, Jongress, federal, state, 
and local School administrators, and teachers, ec'.ujaAonal disadvantage is 
"cured". Such a system can be deficient in many ways, |however, end many 
potential deficiencies have, \n fact, been demonstrated. Attempts to deal 
• vlth these deficiencies have greatly complicated the system. ^ 
^ • The only process in the^del that has not been subjec% to question is 
. the. first, at the top of ^ spiral in Figure 1: it is cl^ar th«t n>any 
' children do not achieve cognitive skills at acceptable levels and that large 
numbers af children who are substantially behind thtf national norms are in „ 
poverty arfas-the need is xiear. The. supposition that parents would be 
sensitive to this need and would effectively t»ove Congress and local school 
administrators to action is questic^ible. Although ^,overty-related citizens- 
groups managed to get resources directed into the poverty coprnmities 
through lobbying efforts, their ability to monitor the a^fctivitics and effec- 
tiveness of the* local school was questioned by Congress at the outset, and 
a provision was added to the law to ensure that each Titl* I project would 
be objectively evaluated once a'year. Prior'to 1?70, examples of active 
. parental involvement fn Title I projects were rare. (Gordon & Koutrelakos (1971^ 
^ in 1970, Congress directed local and stat^education administrators to^ in- 
volve parents in compensatory education planning, a direction that USOE trans- 
lak'd muo guidelines for the formation of Parent' Advisory Councils (PACs); . 
however, despite the survey in 1973 byH^je National Advisory Council on the ^. 
Education of Disadvantaged,Children (NACEtiC, 1974), which indicated that 
there is a great deal of parental involvement, -there is no clear evidence 
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of thft extent to vhlich PACs have taken an active role In t:ompen8atory educa* 
tlon plAnnlng« ' ' . ^ * 

;^ Convensatory education became one of the major vehicles by which the 
"great society" was to be realized. T^e amount Congress authorized was ^ 
far less than recojin^nded levels, $10 t/illlon to $50> billion annualjy (Gordon 
& Koutrelakos, 1971)f'to deal wdth the prbblem, however, and whe^ the Vietnam 
•war and later the rfe^esslon -of the' mid-aeveint?ei*decimated many great; society 
prog^^l^, the approptiations Increased at a\snail's pace, falliqg beitind tnc 
iaflatic^tate for cduca^i<mal costs/ In 197J, oaly 40?t of eligible chil- 
• jdren were reported t^ be pa«4cipating, because of limits^ on funds (NACEDC, 
Vl$74). Also, Congrejis- Vid "not Wecify wfcat actions shp^u^ be taken against , 
^'districts thab do tiot use thfe lltLB I funds strictly .fo^^ihe purpose, of 
meeting the needs ^ disad^jpta^gcd children^. This omiaslpn left program ad- 
ministrators with little flfupfort in efforts fco fensure t>hat\Titie I VoulH * ^ 
woric as effectively! afc pebble. In496y,5kotigre«is'f^^ Apparently not .aware' . 
of the intaensity Q* the problem of. (f^veiopi^S.-aod ;{iqpl'Si^^^ program to 

deal successfully »/ith teducatibnal (Jisadyantag«'S;?^V^^^ scop . There- 

fore, numerous problems occurred and w&re^ub^^Wt^^^^ind^d to through 
legislative amendnLnM, revisioBS of regulationa, and iech'nibai assistance 
from the U.S. Office of Education, .^y 1975, indications are tWt the progr^ 

is more nearly opterating in the Tnanner Congress inVendedf.th^'n ^lier . 

/ • ■ - - • 1 < 

Esp4ciaHy in the early years of title I, federal educattotv ^diHlnistra- ^ 
tora, primarily In the U.S. Office of Education, were understaffed "Jo admin- 
ister so large J prograwf regulations and guidfeltnes were pu^-$lshe)i .^pora- 
dically and aft)fer much delay, and when they did appear , they were criticized 
as based, on to<^ little°forethought. State and lacal administratotfs yere 
frequently left "With conflicting ld<'as of what they were called lipon' t.> do 
under Title I. The uncertain stat^ire of th^ U.S. Office of Educatto.n (USOEX 
iu its dealings with powet groups, such as the Council of Chiel Stata School 
'Officers, alpng with problems stemming 'from competition- among power groups - 
within USOE, led t?o tentative and inconsistent leadership. Although^ these / * 
Statements are strong indictmepts of tfie administration of^- Title 1, 'they 'do \ 
reflect 'concerns expressed by Martin, arid McClure (1969), Warj^, Tallwadge, 
Michaels, Lipe, and Morris (1972k^riggs ^97.3), and Milbrey McLaughlin (1975). 
In summarizing evidence on Ti^le I management in the period from 1^65. 50 
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tLO 1970, Wargo, «t «i. (1972) i ,Vr^te: . ^ 

^ . *- 

Ih« VMhlngton Rasearch Project afid. several more rccen^ stuJies 
oi Tltl^ I managenient ^eem to agree that many of j;h*e admlnistr^- * • * 
tlve problems associated vitli the program luve been or are due to 
(b) the slse» uniquet^».8» and sudden enactment of thie program, (b) 
a general failure at all management levels to accept aJmlalstratlve/ 
*^|responslblllty, (c) a state of local fear of doalnation by higher 
^' levels of authority » (d) negligence in enforcing regulatlons^aflf , 
^lack of necessary leverage to dc so, (e) iincortain and insufficient 
' funding, and (f) over-concern with trac^inj^ tfie federal dollar.. 

By 1975, the frequency ^f administrative problems was gx:eatly diminished 
as the "program matured. . ^ . 

^ State education administrators have not been provided sufficient^ fiind^ 
to' carefully man£[ge the use of Titlc^. I funds in local school districts in^ 
their spates (about IZ of the total allocation goes to state administration); 
however, they have been charged with the responsibilities of approving local 
project descriptions arid assfmbling yearly evaluation reports aggregating ^• 
the results of local evaluations, St neither case with clear guidelines^ 
M fact, state ,educa^ion administrators generally limited their role to, 
ensuring that the local districts received all ch^ Title I funds allot^, to 
them while holding to a minimum'the effort required of local districpa fto 
comply with federal regulations. GAD (1975) found that there was a need f6r 
state^e4u8atioti agencies to establish monitoring systems to evaluate local • 
per formancGf meaningfully/ • * ^ 

Locals administrators were charged with the reijponsibillty for selecting 
Mthods for transforming the financial aid Into i,rt8tructional and relatedj^ 
resources likely meet th^ special ^^ucational, needs of educationally 
disadvantaged children in poverty areas in their districts. They were also 
charged with the responsibilities of (1) selecting as target schools those' ^ 
with the l^ghest concentrations of needy ch^.ldren, (25 ensuring that Title 
I funds were used to supplement rather than replace the school's resources, 
and (3) con<i^icting evaluations of Title I pi;oject0 in their districts. They 
were to select representatives of^parrats of disadvantaged children to form* 
Parent Advisory Councils to provide perspective, in planning, carrying out, 
and evaluating Title I projects. Many instances 'of noncompliance were found 
by the HEW Audit Agency, especiaUy in the fip«t five years (Martin and 
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HeClur«> 1969). After the Initial period » however, nonconipllance has 
bMa greatly reduced, especially due to a greater understanding at all 
levels of the purproses and requirements of the program, A spot check of 
nine states by NACEDC (1974) shoved that, while some expenditures were 
Ipiestloned JLn each state prior to 1970, expenditures in only one:%f the 
states were questioned In the period from 1^/0 to 1972. 

In spite of all the nanagerlai problems In the program, a great deal 
of money has been translated Into compensatory education Instructional re* 
sources, such as special classes or extra teaching aides. The cri : 
In the system Is between teacher and pupil: when the school provides com- 
pensatory instruction for Its pupils needing such li^s^ructlon, do^these 
^l^lls benefit from the Instructlon?^^^ At first. It was ^^xpec ted' that the 
answer <would be affirmative, but as the early evaluations were performed. 
It became evident that the benefits would be difficult to demonstrate. Re** 
actions to the lack of findings varied. First, attemptsj were made to find 
some, methods th^t^ would work. Gordon and Routrelskos (1971) analyzed the 
results of many studies of compensatory education £n terms of methods found 
to be and not to be effective, and others^arched for particularly success- 
fuly projects. Results of the searches included the "It Works" series 

(Hawkridge, Chcaupsky, aud Roberts, 1968), the Project Information Packages 

« 

(Tallmadge, 1974), the Follow-Through models (Rlvlin and Timpane, x974), and 
"Educational Programs that Work" (Far West Laboratory for Education Research 
and Development [FWLERD], 1976). Second, many people began to believe that 
compensatory educat^oa CQuld not work. The very apparent need to help these 
' deprived children, h6wever, obupled with the impetus the program had built 
up in the first few years In terms of supplements to the budgets of schools 
serving iow income area-», precluded halting the prografm. The discouraging 
evaluation results may, however, have slowed the expansion of Title I over 
the last few years < Finally, there was the reaction that the evaluations 
wt*re badly done. and therelore were not to be trussed, Inoeed, those who 
carried out the nationals evaluations generally acknnwledted the weakness of 
the data with which they worked, pointing ouc the need for more thorough 
studies while reporting what results they could infer. 

There are three major tasks that the Title I system* must accomplish: 



(1) selection of participants, (2) /delivery p£ compensatory education 
to participants, and (3) reporting of results as a means for improving 
the system. . Congress and USOE. havft^aid down general rules for achieving 
all of t^ se, although the rules by themselves do not constitute a com^ 
pr^'^naive guide for carrying out the t'Mks« USOE has provided an acctjomi- 
lating amount of technical assistance capability over the period of Title I 
operation. This has taken the for* of formal regulations and guidelines in 
the case of participant selection, the form of dissemination of exemplary 
pr6j«c.t models In thn case of treatment delivery, and the form of detailed 
specification of evaluation models and the provision of regional evaluation 
technical assistance centers in the case or reporting results. 

. The first task, selection of participants, is accomplished in three 
stages. First, funds are allocated to local school districts (LEAs) on the 
basis of the number of children of lov-incom^^amll^es residing In the 
districts. Over 90% of the nation's students reside in districts that re- 
ceive Title I funds. Second, funds are allocated to schools within districts 
by local administrators. Regulations from the federal government specify 
that the funds are to be allocated to the schools senMng the mc .t economi- 
cally disadvantaged children, and that except for Title I funds, the ex- 
penditures at Title I and non-Title I schools are to be nearly the same. 
The level of concentration of funds on a few or many schools in a district 
is at the discretion of the local administrators, althbugh federal guide- 
lines suggest that each participating student receive the benefit of at 
least a 50% increase in resources over nonparticipating students. The 
discrepancy between congressipnal authorization and congressional appropria- 
tion of ''funds, howevet, has meant that providing a 50% increase to sr-ie stu- 
dents mecessitates limiting the number of participants to only some ot the 
disadvantaged students. Third, selection of participants within schools is 
less formally specified than selection of schools, but the most education- 
ally disadvantaged children (elg., those who are more* than one year b^low 
grade ievel in achievement) are supposed to be selected. Whether the allo- 
cated funds should be concentrated on a f6w. very needy children in order to 
achieve large gains or should be sptead across many disadvantaged children 
is a continuing controversy. Because evidence is lacking that Title I 
expenditures are correlated with project effectiveness, the case for 
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coacdntr&tion in weak. In order to determine appropriate levels of concen- 
tration, it la necessary to establish "bench marks" consisting of specified 
curriculum packages whose costs and* effectiveness are well known. 

The second major task, delivery of compensatory education, is left by 
Congress to .the local school administrators and teachers, and schools differ 
both in their specific objectives for compensatory education and their me- 
thods. The critical need for carrying out this task successfully is to pro- 
vide teachers and local school administrators with information about compen- 
satory education treatments that are effective. In order to help teachers 
select effective methods for meeting their compensatory education objectives, 
USOE published a series of descriptions of successful projects in 1969, it 
mounted a major effort (PIPs) to package the operations of successful pro- 
grams in 1973, and it has established a national diffusion network tp com- 
• munlcate descriptions of projects approved by its joint* dissemination review 
panel. Also, a comparison of the effectiveness of different methods has been 
included in every major federal study of the effectiveness of compensatory 
education. Thus, the federal i^ole in this task has been one of support for ^ 
developing and dlsseminat^lng local efforts. Nevertheless, although many 
show potential, \o method^ have been developeS into unqualified successes. 

The third task, reporting of results in order to facilitate program 
. improvement, was only vaguely recognized as a need at first. During the 
^ first five years of Title I, the mktn thrust of evaluation reporting was to 
provide information on the ways in which Title I funds might be purposefully 
or mistakenly misused, so that legislative and regulatory Improvements cbiild 
be properly made and technical assistjihce could be provided where most needed. 
As early as 1967, however, serious evaluative efforts were begun to determine 
whether Title I was effective and t6 identify the most effective compensa- 
tory education treatments. In nearly every case, such evaluations have 
been based on the data collected for the annual reports required by the law 
to be carried out in each district receiving Title I funds. This annual data^ 
collection effort was developed as a multistage process, with pupils' gain 
scores aggregated by teachers , whose reports were aggregated by local dis- 
trict administrators, whose reports were aggregated by state administrators, 
whose Reports were aggregated by federal administrators into a report to Con- 
gress. Withoyt precise guidelines, the evaluations and aggregations at each 
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level used different methods and units, rendering aggregations at each 
further level nore tentative and less valid. As late as 1974 (Thomad and 
Pelavln, 1976), attempts to aggregate state reports were severely limited 
by the lack of uniformity of reports across states and the general lack of 
rigorous e iluatlon designs at the local level • In the 1974 amendments to 
Title I, Congress requested more usable evaluations « USOE commissioned the 
development of a few standard evaluation models (Horst, Tallmadge, and 
Wood, 1974} and established regional technical asilstance centers tp help 
state and local education agencies conduct usable evaluations. 

The structure of this synthesis of the results of a decade of federal 
evaluations of compensatory educati.jn follows these three^ major tasks, 
participant selection, treatment delivery, and evaluation reporting. In 
addition, a section Is Included on ef fectlvenessr ^s measured by student 
achievement gains; both average effectiveness and variation In effective- 
ness across participants and treatments are considered In that section. « 
Alsq^ a section Is Included that summarizes tlie problems that have ^con- 
fronted the title I program, as set forth In the studies reviewed. To- 
gether, these sections cover the copies on which Gamel, Tallmadge, Wood, 
and Blnkley (19/5) found that federal policymakers needed Information. 
"In essence, the major concerns expressed we:re centered on the necessity 
of knowing how Title I funds are spent, how targej grqups have been de- 
fined, how needs of the groups have bee a assessed, and If the treatments 
have resulted In significant educational gains" (Gamel et a\. , 1975, 
p. 34). Methods used for needs assessment Is one topic about which little 
has been reported. 

The primary sources of Information for the synthesis are shown In 

.Tabie 1. These do not, of course*^ exhaust the literature relevant to 

these questions; however, they Include the large majority of the sources 
of information reviewed In this study. 

This synthesis Is limited in four ways. First, It focuses on only 
a part ot^ltle I, namely, the main program category of aid to local school 
districts serving low-Income areas; and Title I Itself Is only one of several 
federal programs to meet special educational needs; and the report virtually 
Ignores the numerous state and locally^ funded compensatory education programs. 
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In addition-' to the main Title I aystem described here, there are other 
catagorlea aimed at Improving education for Institutionalized delinquents 
and for children of migrant workers. That Is not. a severe restriction, 
hoiravar, ^.becautfa, In igTZ-^TS for exampleV the main, "lo%r-lncome" progi^am 
in Title I accounted for over 95% of Title I expenditures and for over 
40X of all federal financial support for education.. 

Second, the synthesis la baaed on a cii^ll, albeit central, portion of 
the relevant literature. A aearch of ERIC for reports on "compensatory 
education" or "Title I" yielded 1,754 reports during the period 1966-1976. 
Although many of these repot ts were lotal evaluations, there were dozens of 
apparently relevant ^reports that couLd not be reviewed within the acope 
of thla project. Furthermore, <4t has become apparent to the project staff 
that a deep ffmlllarlty with the literature on treading research (and re- 
search on other cognitive skills) la necessary for those who would seek 
to liq>rove compensatory education. In particular, measures of achievement 
gain used In program evaluation will continue to be amblgupus until they 
are based on acceptable models of the growth proceas, pe^rhapa building on 
the work of Carroll (1974) or Gibson (1970) . A brief review of. theprles 
of the acquisition of reading ability was provided recently by Williams 
(1973). . 

Third, the scope of this study precluded reanalysls of the data 
collected In any of the studies reviewed. Althouglh many qf the data pre- 
sented In those studies are tranaformed and re^omblned In this synthesis, ^ 
evaluation of the validity of thoae data Is primarily limited to not^jtig the 
authors' disclaimers and applying general rules for evaluation of validity 
to the data collectlcm and analysis operations described In the reports. 
Only In the case of the Compensatory Reading Study (Ttismen, Waller, and 
Wilder, 1975), the largest and most promising of the studies, reviewed, 
have more than superficial Inquiries Into the project's operations been made. 

Fourth, and finally, the synthesis la limited to studies essentially 
. comideted by the end of 1976. Two major current efforts are not incorpor- 
ated into thfi synthesis, and it Is to be hoped that their results will fill 
many df the gaps of knowledge that exist. These two efforts are the Sustain- 
ing Effects Evaluation, which USOE t ^rojigh the Office of Planulng, Budget- 
ing, and Evaluation, has contracted to have System Development Corporation 
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carry out, aad the National Institute of Education's compensatory educa- 
tion assesaoent project, of which, this synthesis Is a small component. 1 
regard to the NIE assessment project, the conclusions reached and criti- 
cisms made about evaluations of compensatory education in this document j 
its companions may or may, not apply t<x empirical evaluations currently 
funded through NIE. The authors have operated essentially Independently 
of the other components of the NlE study. 
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Partlcly&nt Selection 



The purpose of Title I la to provide services for a small segment or 
thVi^rlcan population, the 5 million school-aged children who live In 
low- Income areas and who are judged to need compensatory education In order 
to bring their scholastic achievement up to the level typical of their age 
group. ^ Participation of children In Title I programs Is clearly an Inter- 
mediate outcome of the system, not an ultimate outcomer. In lieu of evi- 
dence of impact on achievement, however, this is the most. logical criterion 
variable to substitute as an indicator of program impact. By reasonixig 
that there l£ at least some positive effect of the program although not 
evident In test scores (e.g., reduced absences, le«s violence, better atti- 
tudes), the amount of that (unmeasured) ef|ect would be' proportional to 
the number of participants. Moreover, participation is a necessary con- 
comitant to achievement as an impact measure:* proper Title I impact is 
limited to achievement gains of disadvantaged children; a project .which 
served other children and showed achievement gains would be misguidecf. 

The primary question concerning participation is whether (1) substan- 
tial numbers of children falling within the specified category are not par- 
ticipating in Title I or (2) substantial numbers of other individuals are 
receiving aid through Title I» to the detriment of disadvantaged children. 
Because the rules for participant selection are >^ased on a combination of 
Aconotoic and educational disadvanta jsm im i criter ia , ^auiyibsldiary^ 
some iiiportance concerns the strength of th# relationship between economic 
disadvantage and educatiotAl disadvantage. To the extent that they are 
closely related, then allocation of resources according to either one or 
the other cri^er^n is largely an academic question. If they are not re- 
lated,^ primary assumption of the program (that Economic ^advantage- l«ads 




to educational disadvantage) is brou^t Into qu^dtion, A third question of 
inportance in evaluation of- the participant selection process. coriWrns 
whether any identifiable segment of the population is r^eceiving an anplUnt of 

assistance not in proportion to their educational /ind economic disadvantage. 

* ft 

Some segments of the population have greater needs and can be expected to 
be participating at greater rates; however, it is equally possible that some 
groups with needs are being overlooked. In order to vejrify the fairness of 
the allocation, it is necessary to examine the needs and rates of partici- 
pation of different ethnic groups, different regions, different types of 
comnunities, and even different age groups. 

la addition to general questions about participant selection, there are 
three specific problems that require particular Attention. 

1. Because funds are limited, a choice must be made concerning hoy 
many of a district's disadvantaged children are to be selected 
to participate. It is not clear whether it is better to. concen- 
trate funds on services for the most severely disadvantaged chil- 
dren or to spread funds to a larger set of children. Therefore, 
being able to identify different levels of concentration for 
different segments of thp student population may be a crucial 
step in identifying the effects of concentration, if the popula- 
tion segments are found to benefit differentially from compensa- 
tory education. Although Tallmadge (1973) found virtually no 
correlation between per-pupil expenditures and effectiveness, nor 
^' did Flynn, Hass and Al-Salam (1976), Kiesli<ng (1972) did find 
such evidence. Several SQurces have suggested that small-group 
or individualized instruction and instruction by specialists 



are components of successful compensatory education projects, and . 
those types of instruction are costly. ^'^^ 
Because Title I funds represent only a small portion of most schools' 
budgets-, the relationship between Title I expendit ;S and other ex- 
penditures in the same district has been the focus of much atten- 
tion. If, in fact, the funds are used for general instructional 
resources, designation of students who were participating within the 
district would be meaningless. In 1972, strict requirements were 
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set forth' concerning this relationship. Basically, the con^ 
cept of the requirements was that Title I funds should not 
supplant other funding sources, paying for servl<:es. that would, 
have been provided In any case, but rather thai local and state 
expenditures for^ltle I schools ipust be demonstrably comparable 
to expenditures In non-Title I schools In the seme district, so 
that Tltl^ I would provide supplementary services for dlsadvan^ 
taged "ihlldren. ' * ^ 

3. Because nearly SOZ of the participants In Title I are black, and 
because ?«gregatlon has been such a' difficult problem for schools 
. to deal with, care must be takelr^hat strategies for compensatory 
education do not become strategies for segregation. Martin and 
McClure (1969) pointed out several ways in which this could occur; 
Wargo et al. (1972) noted that de facto se^egation occurred In 
Title I schools; and Trlsmen et al. (1975) suggested an Interpre- . 
tat Ion pf their data as Indicating that segregation mighc be occur- 
^rlng through assignment of blacks to "separate" classes. There 
appear to be no data avalla(ble, however, to test the hypothesis 
that there Is more (or less) Interracial contact because of Title I* 

There are three methodological probems to be dealt with In assessing 
participation In Title I. First, there Is the problem of Identifying 
participants. When Title I funds are used to employ a teacher axde In an 
elementary classroom. It Is inefficient to set arbitrary rules about the 
extra time this allows for Individual attention to particular "compensatory 
education participants". Although the teacher Is likely to designate a 
few students as Specially In need of attention, that does npt Imply that 
all ch:^ldren In the classroom will not benefit. ^ In fact, the primary cri- 
terion In the Initial study of Title I Impact (the TEMPO study) was class 
mean achievement gain, not the gains of a selected ^et of "participants", as 
has later been the primary criterion for Impact. The second problem Is In 
the tneasurement of amq;unt of participation of an Individual. So far, no 
attempt has been made to Identify an amount of partlclpatjbn by a pupil to 
be considered as a "full-time equivalent"; participants a^e counted ^e 
same for most analyses In most studies no matter how many hours pf extra 
attention are targeted to, their problems or how many hours. they are actually 



prevent for the instruction:. Yet strong arguments have been made tl\at ex- 
peavre tl«e to instruction is an important factor in achievement. ' A third 
_probl«i. vhich has been dealt with in some cases, concerns the participation 
of a pupil in two or mor^ Title I projects within a year. Although an 
argument can be made for counting each project 4nd pupil combination as a 
participant, this makes Impossible the analysis of- pet^entage of particlpa- 
tlon—the nuri)er of. participants would frequently be greater than the ramr 
ber of students in the school, Tlws, interpretations of the nu>Jbef of 
participants reported in a^^ survey should be. made cautiously. In attempting 
to present as much Information as possible in this section, we have ,made sim- 
plifying assumptions, such as that all participants can be counted equally. 

There are two primary sources of data relating to these general .quest- - 
tlons and several ancillary sources relatlag to more specific questions .^^ 
The priMry sources are (1) thi national surveys of the 1967-68 and 1968-69 
school years (sunparized by Wargo et al., 1972) and (2) the CPIR surveys of ^ 
1969-7a, i97iT72, and 1972-73, by the National Center for Educational" Statis- 
tics (NCES, 1»971, 1975, 1976). Some state report sf" have provided supplemen- 
tary^, corroborating, and contradictory evidence, as presented by Briggs (1973) 
aaiJcamel et al. (1975). The Compensatoir Reading Study (Trlsmen et al. ,1975), 
^^fiough its sample was not;strictly representative, produced data relevant 
to the relational questions. Finally, the annual reports of the Nat^^onal 
Advisory Council on the Education of Disadvantaged Children to the 'President 
and Congress contain some relevant information. , ^ 

' The surveys of 1967-68 and 1968-69 and the Compensatory Reading Study 
.were limited in focusing 6n three elementary grades (specifically, grades 2, 
4, and 6). Thus, they do not"" pertain to the total compensatory education 
program of many .districts. The NCES surveys tend tl> treat qu-.stions of 
participant characteristics and of students' needs superficially,* presurn-^ 
ably because of their need to minimize the response burden on local scho'ol 
administrators, '^e NCES surveys are most helpful in obtaining global - 
estimates of the scoJJe of program operations (Title 1 is merely three of ^ 
the fifteen different federal program categories covered in the CPIR) . 



* For example, economic disadvantage has been indicated only by the fact 
that the child attends a school designated as^eJigible fot Title I 
assistance. ' 



1^ TKe small nymber of State Title I Anhual Evaluation Reports that have pro- 
\ vlded aggregatable data on participants severely llmijts the u.tlll^y bf these 
reports to assess participation ap the national level. According, to Gamel*' 
- ^ ^'et al. (1975), they/"are neither sufficient nor consistent enough to form ♦ , 
a nationally representative picture of Title I ex^ndltures''^ (p.. 88). ' 

Overall participation . As shown In Table 2, the number of chlldfen 
participating In Title I programs first Increased and then decreased. The 
* expenditure per pupil has apparently risen over the years, although the 

supporting data are *not clearly valid. The comparison af per pupil expendi- 
tures across years based on different reports is particularly tentatlvl^ 
because it is not clear which different categories of expenditures may hav« 
been inp^uded in the total expenditures in different years (e.g.,. state ad-^ . 
minis tratlve costs, Inst Itutlonall zed program funds, and Parts B and C) 
oor what counts of students were used for the^ratlo. .The only source we ' 
reviewed that contained expenditures for the whole^llcade was the 1975 ^ 
Annxi^l Report of the Office of Planning, c Budgeting, and Evaluation in the 
^ U.S., Office of Education ^ Also shown in Table 2 is the estimated population 
of *f chool-aged children in areas served by Title I eligible schools and of 
all school-aged children. The large Inumber of children in Title I schools 
J reported by NCES during the 197.1-72 sthool year is unexplained^ its devla- - 
* tlon from figured for 1969-70 and 197zV3 is far beyond the levels^f ran- 
dom statistical error reported for the survey. Altlfough the questionnaire 
, ^ vajrled slightly 'frbm year to year, there is no obviiy^ explanation In terms' 
of change of definition. If other errors of this magnitude (we asstime the 
. true figure for 1971-72 was no more than 20 million) are ^present in the 
survey, it dampens the confidence that can be placed in conclusions based 
on the NCES CPIR survey, at least for the 1971-72 school year. ' ' 

The most important generalization representred in the figures in Table^ 
2 concerns the size of the program: although it is large, it sill only re- 
presents 20Z-30Z of the educational costs far only 10%-20% of the nation ^s 
pupils — i.e. about 3% of all school expenditures. 

Later, We shall refer to results from the Compensatojl^ Readlitg Study 
(CRS) (Trlsmen et al. 1975) concerning participation. Although the reciults 
of' that 3tudy (in particular, of Phase 2 of th^t ^tudy, i/hlch assefjsed stu-' 
dent chaise texisti^s) were not Intended to be quantitatively i^^resentatlve 
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Table 2 

Overall Level of Title J. Participation and Funding 



1965-66 1966-67 



^967- 



68 1968-69 1969-7^ 1970-71 1971-72 1972-73 1^73-74 1974-75 



8.3* 



9.0* 



10.5* 



7.9* 



7.4', 1.^ 



5.9' 



5.6' 



( 



.96* 



117' 



43.r 



,98 
1.04* 



108* 



'34' 



45.0^ 



.1.07' 
1.14* 



192' 



. 3>^ 



.a 



1.00 
•1.05* 



127 
164* 



40' 



45.9' 



l.i2* 



219' 



48" 



24.6* 



45.9* 



1.30' 
1.52* 



243 

^^220* 



21^ 



Participants 
<lii ttilUoaa) 

Tltla I School 
Population (In 
milllona) .? 

f 

Total School 
Population 
(In ttllllons) 

Title I Expen-* 
dlturea (in 
blllioM of 
dollars) 

Title I Expen- 
ditures per 
participant 
(in dollars) ^ - 

Total Expenditures ^ 31^ 
by Eleaentary and 
Secondary Schools 
. (in billions of 
dollars) 

^argo et al. (1972), based on information auppliejMiy USOB 
**HCBS CPIR survey reports. 
*^The ^nditibn of Education, vol.. 3 (1977). 
•^Ga-el et al. (1975), unweighted mean of about 25 state report* per year, 6nly J 3 reports for 1973-^4. 
*USOB iwluation Report a976), approprx^tions, not ii»eluding flgrant and negUcted or delinquent 
children's progfraAs, w^r ^han expenditures. > , 

hheftttdes public scholpls iSly,, pM^K through"^2th grade. , . " /" . 

8HACEDC report. (l7nM9^ ,/ 1^75. 197|) . Expenditure. In Part A for LEA.' progrM« for low-ipcce areas. 

^ - > ''^^ • ' " - ■ ■ ^ 



i9;-8^ 



45.7 
45.6* 



1.09; 



147* 
184' 



44' 



18.2' 



45:4' 
45.8' 



1.23" 
1.39* 



276 

a3r 



58* 



45.1' 



291' 



-64' 



44.8' 



1.76; 
1.59* 



69* 



27? 
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saapltt, and It provides the only relevant data for some questions concerning 
partlclpal^lon. Although the CRS oversampled schools not providing compensa*^ 
aatory reading Instruction, that should not affect conclusions about^ for ex-* 
caple, the relative participation of girls and of boys In compensatory read- 
ing activities. 

Participation and economic ^nd educational disadvantage * The surveys 
^ of 1967-*68 and 1968*^69 Identified six categories of relative need and estl- 

meted the proportions of children In each category. Theae_ proportions are — . 

shoim In Table 3, along with the proportions of each category of students 
who were served by Title I. Although thesp data rely on teachers* subjec- 
tive estimates, pertain to the situation of 3 and 9 years ago, and should 
npt be taken as Indicative of the situation In 1977, there are several im- 
portant points to be noted from them that m.lght be Investigated in future 
studies (no comparable data are available later than. 1968-79). The points 
are: (1) only 40Z of economically disadvantaged children (categories I, II, 
IV, and V) were in Title I schools; (2) about 1 in 4 educationally disad- 
vantaged children (categories I, II, and III) in Title I schools received 
more than 100 hours of compensatory basic skills instruction in 1968-69, 
but so di^ aboLt 1 in 10 children who were not educationally disadvantaged; 
(3) the intenjBlty (more than 100 hours) of compensatory basic skills In- 
struction was greatest for severely economically disadvantaged children 
(about 80Z of participants received more than ibO hours — Column H divided 
hy/^!^\xm G) and least for non-ec<$nomlcally disadvantaged children (about 
♦ 55Z) , 'although lo^ic would cali f or differentiation of intensity on the basis 
of educational disadvantage; and (4) per-pupll Title I expenditures were not 

— ' related to economic or educational dlsadvantagement levels. Note that these 

problems in participation may be either in assignment c"" individual students 
within classrooms or in selection of program emphasis at a higher adminis- 
trative level (e.g., dis^^PScT^ state). The fact that errors in assignment 
of Title I funds and activities for pupils may have accurred indicate a 
need for similar study of participation by categories of need in 1977 to 
evaluate policy changes in the formula for allocation of finds and selection 
of children. 

In 1972, the Educational Testing Service collected somewhat relevant 
data, foctising on compensatory reading programs rather than all of compensa- 
tory education, in the Compensatory Reading Study (USOE, 1976b). That study 
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VM Mptelally Important In that It compared compensatory reading programs 
at schools that did not receive Title I funds with rl^Luse that did,* The 
no^on some niay have that Title I Is the main source of funds for conpensa^ 
tory education can be dispelled by examining the numbers In Table 4: for 
example» 3SZ of students In non-Title I schools were receiving- such assls' 

tance, compared to 45Z orstddents In Title I ^schools,. A surprisingly lar^e 

> 

imrcentage of children In grades 4 and 6 were year or, more below grade 
level In reading. Of those who were a year or more below grade level, only 
about two In three received compensatory reading assistance, even In schools 
with Title I funds, while one In fOvr of the other children also received 
such assistance. Before concluding that compensatory efforts were being 
misalloicated, however, the reader should remember (1) that achievement tests 
are not perfectly reliable and^ possibly not as valid as carefjil teacher 
judgments o^ need for compensatory Instruction and (2) that the clayslflca- 
tlon of a particular child as a "participant" In cotdpensatory reading was 
also a teacher^ judgment, and although It was a sf^alght forward judgment 
whenever children were pulled out of class for special Instruction, children 
receiving In-class treatments are more difficult to Identify. 

A particularly distressing problem of funding allocation polnteld out 
In the survey of the 1967-68 school year was the dilution of per-pupll 
Title 1 e^endltures In just those districts where pupils would need It 
most» The results -are reproduced In Table 5. As stated in the report of 
that survey (USOE, 1970), "the poor child in a low expenditure district 
^inds himself disadvantaged in at least four ways: (1) he and his family 

poor; (2) his school is poor: (3) his school district receives propor- 
tlc^^ely fewer Title I dollars with which to provide special services; and 
\(4) he receives a smaller share of those few^r Title I dollars" (p. 10). 

The relation between economic and educational disadvantage Is an Impor- 
tantX^ationale for the Title I funding formula. Data in Tables 4 and 6, 
from tl^e Compensatory Reading Study and^ 1968-69 USOE survey (Glass, 1970) 
respectively, indicate a strong relationship. Thus, allocation according 
to ttonoi^c disadvantage does assure that a large number of educationally 
disadvantaged pupils will be serve4« Finally before turning to factors other 



\ — .. . 

* The results quoted that are based on the Compensat9ry Reading Study may be 
somewhat biased In that they represent schools that indicated their willing- 
ness to part\Lcipate in the study earlier than others. 
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Table 4 

Relations between Educational and Economic Disadvantaged 
and Compensatory Reading Participation, among 4th and 6th Graders, in 1972^ 



Title I Schools Non-Title I Scho i 



Percentage students receiving 
compensatory reading Instruction 

Reading National Percentile Ranks 
of compensatory reading participants 

Reading National Percentile Ranks 
of other students 

Percent of students how were one or 
more years below grade level in 
grades 4 and 6 (i.e., educationally 
disadvantaged)* 

Percent of r'educationall^ disadvan- 
taged children who receive compen- 
satory reading assistance 

Percent of noneducationally dis- 
advantaged children who receive 
compensatory reading assistance 



Percent of Free Lunch participants 
who are educationally disadvantaged 

Percent of Free Lunch nonpartici- 
pants whoare educationally 
disadvantaged 

Percent of Free Lunch particiMnts 
who receive compensatory readcig 
assistance 

Percent of educationally disadvan- 
taged Ftee Lunch participants who 
receive compensatory reading 
assistance 



45Z 



2)1 



46Z 



31Z 

64Z 

25Z 
63Z 

38% 

55Z 



en 



35Z 
24Z 

_53r- 



37Z 

60Z 

20% 
44Z 

33Z 

38Z 



60Z 



Source: The Compensatory Reading Study (USOE, 1976b) 
*Term used for this table only; not used in original. 
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Table 5 

S 

Per-PupU Title I Expenditures, Related to 
Regul^ir Scliool District Expenditures and Pupil Participation 



Percent of Pupils Wlio Participate In Title I Programs 



' , Regular 












Average 


\Per-Pupll 












Percent of 


Exp«ndltures 


0-25 


26-50 


51-75 


76-100 


, Total 


Participation 


LessN^han $425 


$225 


$158 


$158 


$66 


$108 


68Z 


.$425-$625 


$241 


$160 


$171 


$83 


$174 


39Z 


Greater \han $625 


$282 


$152 _ 


. $268 


$107 


" $226 


47" 


Total 


$243 


. $158 


$200 


$70 


$142 


44Z 



NOTE: Data from the USOE survey of compensatory education during 1967-68.. 
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Table 6 



Percentages of Title I Schools with Varying 
Concentrations of Educationally and Bconomlcally Disadvantaged Children 



Concentration of Educationally Disadvantaged Pupils Total*** 



Concentration . 

of Economically Low Medium High of'sch^ls 



MMduaetaged Pupils** ^^ess tha n 3 1^ 10) (Between 3 In 10 and 7 In 10) (More than 7 



Percentage 

In 10) 



Hone 3Z 



IX- OX ' 5% 



'""■t'lrA''" '"^^ 31Z 38Z. « ,78% 

7X ' n ^ 17Z 



Mpre than 1 In 4 



2X 



^"fS"" ' 36, «7X 16X 100, 



Expressed as proportion of the 'school's pupils who were one or more years below grade level In reading. 
Expressed as proportion of the school's pupils whose families were on welfare. ; 



***Totals may differ from sums, due to round-off ertor. 

Note: Data from 'the 1968-1969 survey (Glass, 1970). « 3,, 



than economic and educational disadvantage ^ ve can see from another table 
baaed on the 1968-69 aurVey (Glass, 1970), Table 7, that compensatory reading, 
language, and math Instruction were the most prevalent critical needs noted 
by teachers, and all the needs were more frequent among pupils with. severe 
economic disadvantage (categories I and IV In Table 3). 

Participation by ethnic groups . The number of participants In ^Title I 
programs from four ethnic categories Is shown as Table 8. The evidence sug- 
gests the tentative conclusions that (1) more whites than blacks participated 
In Title I activities; (2) blacks and Spanlsh-sumamed children have parti- 
cipated In far greater percentages than they are represented l(i the total 
population of the country; (3) the overselectlon of ethnic fludjiorltles has 
been both In the selection of districts and In selectlon^b^' students for 
conpenaatoiy academic Instruction within districts; and <4y the focus on 
ethnic minorities did not change between 1968 and 1972. 

The reason for overselectlon and ovei^partlclpatlon of ethnic minorities 
la clearly their greater need for compensatory education. Figures In Table 
9, from 1967-68 and 1968-69, show that they have serious disadvantages of 
both economic ilnd educational types more frequently than whites. Percen- 
tages of disadvantaged students who actually participated in Title Laca- ; 
demlc program during 1967-68 did not vary greatly between blacks an<2 whites. 
However, a larger proportion of the most seriously disadvantaged Spanish- 
surnamed children participated than of their white and black counterparts; 
and among blacks, there wa9 very poor discrimination of need levels in se- 
lection for participation. 

Corroborative data on ethnic differential economic needs were collected 
by Rooted Cata (1970) (reported in Wargo et al., 1972). During 1969-70, 
39% of b'lack school-aged children were members of families that were **below 
the poverty line", compared to 10% of whites. 

Corroborative data on ethnic differential educational needs and par- 
ticipation were provided in the Compensatory Reading Study (Trismen et al., 
1975) as shown in Table 10. Apparently,' general participation in academic 
compensatory education programs has not been based on ethnic group member- 
ship, other than because of its correlation w.th need. Trismen et al. (1975) 
suggested, however, that the type of program Aethodology might vary between 
ethnic groups. They found that among blacks and Spanish-surnamed students 
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Table 7 

Percentage b£ Students in Title I Schools 
with Particular Critical Needs, 1968-69 



Critical Meed 



Percentage with Heed 



1. 



All Pupils 



Pupils w^th Severe 
Economic Disadvantage 



Heading 


A3Z . 






672 




Langiiage 


. 372' 






6A2 




Math 


37% 






592 




Cultural enrichment 


272 


S 




452 




Health 


112 






282 




> Psychological counseling 


102 . 






142 




Food 


62 






272 




Special education 


52 




9 


112 




None 


342 






92 





Note: Data from the 1968-69 surVey (Glass, 1970). 



Tabie 8 

Number of Participants in Title I ActiviCtes in Four Ethnic Categories 



Ethnic Q»Lepory 



^ I* 


Blac^i 


White 


Spanish'Susnamed 


Other 


t 

Nuittber of Public School Students, 1968-69, 
grades preK-12 


6,282,173 
(UX) 


34,697,133 
(80%) 


2,002,776 
. (5t) 




371,486 
(1%) 


Nufrf>er in Title I School Dii^tricts, 19b7-68, 
grades 2, 4, 6 


1,399,209 
(22%) 


4,480,232 
(72%) 




(6%) 


« 


Nunfcer in Title I School Districts, 1968-69, 
grades 2, 4, 6 


1,299,114 . 
(23%), 


3,999,59/ 
(71%) 




370,432 
(6%) 




Number 9f Participants in Special Title I. 
Programs, 1968-69, grades 2, 4, 6 


439,939 
(-30%) 


899,668 
(61%) 




131,238 
• (9%) 




Number Receiving More Than l(fO Hours of 
Title I Academic Instruction, 1968-69, 
grades 2, 4, 6 


270,809 
(38%) 


, 361,298 
(51%) 

• 


^ 10% 


77,515 
(11%) 




Estimated percentages- of Compensatory Reading 


26% * 


62% 




2% 



Notes: 1967-68 and 19^9-69 data were based on the national surveys and therefore include only 2nd, Jth, and 
6th arade«. 1972-73' dsta were based on the Compensatory Reading Study. Percentages are relative 
- to roi JoJIis ''Whites" refers to non-Spanish sumamed whitest The different terminology special 
p?og?Lis" "activities," and "participants," between 1968;^9 and 1974-75 make, comparison of the 
figures risky. • 
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J Table 9 

Percentages of Ethnic Groupa in Different Dlsadxantage Ca^egorleo, fcr 1967-68 and 1968-^69 



Categories of Dlaadvantage 



I. Under $3000 annual family income 

, and Ifess . than high school ability 

II. Between $3000 and $6000 annual 
faBiily income and less E)?an high 
school ability 

III. Above ?^000 annual family income 
and les-> than higli school ability 

IV. Under $3000 annual family Income 
and at least high school ability 

V. Between $3000 and $6000 annual 
family income and at least high 
school ability 

VI. No serious economic or educational 
disadvantage i 



Blacks 



Uhites 



Spanish*Sumamed 
and Otlter 



1967-68 1968-69 1967-68 1968-69 1 57-68 1968-69 



16 (52)* 
12 (44) 



2 (45) 



26 (53) 
31 (46) 

12 (40) 



13 



13 



3 (52) 
7 (51) 



2 V, 3 (40) 
5 (45) 



21 



36 



14 



25 (f37) 



56 (23) 



3 ' 
7 

4 
3 
26 

57 



12 (64) 
15 (62) 

3 (47) 
15 (5C) 
37 (47) 

18 (40) 



ion 



100 ' 100 



100 



100 



9 

15 



12 



40 



21 



100 



Were in parentheses .re the percentage of those with needs who actually participated in Title I , 
academic programs. 

««^«. Rsrlmates bv teachers provided che basis for classification of whether a child possessed the 
lll^lll nL:::2rto^^VX*te high school and for classification oi f^J^^o^e. Data 
are from the USOE surveys o^ coapensatory education during 1967-68 and 1968-6!*. 
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Table 10 



Percentages of Ethnic Group3 In the Lowest 30% of Reading Achievement 
and in Cdnpensatory Reading Programs, Grades 2, 4, and 6, in 1972-73 



Blacks Whites Spanish-Sumanied 



Percentage in Lowest 30Z of the 65% 21% 60% 

Population in Reading Achievement 

Percentage Receiving Compensatory 69% 33% 70% 

Reading Instruction 

NOTE: Data are from the qualitatively representative sampljB selected for 
the Compensatory Reading Study (Trismen et al, 1975). 
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there was a greater tendency for compensatory and noncompensatory reading 
Instruction to be carried on in separate classrooms than for whites.* Tris- 
nen et al., (1975) inferred from this that "such student assignments are 
being made at least in part on the basis of ethnicity, apart from reading 
level" (p. 75). Although that conclusion might be partially true, it does 
not follow from the data analyses they reported, A reanlysis of their data 
within those schools in which compensatory and regular reading students are 
separated, searcning for instances of misassignment in order to achieve eth- 
nic howgenetty (or ethnic heterogeneity) of- the instructional environment > 
is called for. 

Participatlca bv grade level . As shown in Table 11, the emphasis so 
far has been on the early grades, and that emphasis increased between 1968 
and 1974. Where conflicts among' data sources exist, the .figures from the 
national surveys by NCES are probably more accurate than the figures based 
on subsets of state reports (Wargo et al., 1972; Gamel et al., 1975) be- 
cause those state reports were not weighted to remove bias when aggregating. 
The increasing number of Title I participants in the early grades contrasts 
with the decrease in the percentage of the total population in those grades: 
from 1969-70 to 1972-73, the percentage of the nation's pupils who were in 
preklndergarten through third grade declines from 30. 5% 'to 28.5%. 

Participati on b y size and- location of school distr ict. According to 
the NCES surveys of 1971-73, as shown in the left-hand columns of the body 
of Table 12, Title I participants tended to be in smaller districts. This 
result Is misleading, however, because ^t ignores base rate expectations: 
in fact, overall, more children were in the smaller districts, and it was 
among children in the largest school districts that the participation rate 
was greatest! 

The 1967-68 survey collected inform tion on needs and participation 
in different types of communities. Bas'^d on those results, the data in 
Table 13 indicate that generally the same proportion of children with severe 
needs parricipated in all community types other than suburbs, where more of 
the children with severe needs were missed', however, there tended to be 
greater participation by the nondisadvantaged in larger cities. 



* It is not clear from their report whether this r.endercy was a within-school 
phenomenon or a between-school or even a between-region o^enomenon. 



table 11 



Percentage of Title I Participants in Different Ranges of Grade Levels 



School Year 

Grade • 



1968-69 1969-70 1970-71 1971-72 1972-73 1973-74 



Pre-K - 3 


39 ,37 


/.I* An^ "^ft^ 


42** 46^ 


43**, 52^ 


45^50^,43*' 


47^ 




(38)* 


(40) 




(47) 


(45)^ 


(4?) 


4-6 


29* ■ 


30*, 28*^ 


29^^ 


30^ 


33^, 29*^ 


33^ 




(29) 


(29) 


(29)' 


(30) 


' (30) 


(33) 


7 - 9 


22*,2l'* 


19*, 19**, 22*^ 


18^15^ 


17^13^ 


16^13^20•= 


13^ 




(22) 


"(20) 


(17) 


(15) 


(17) 


(13) 


10 - 12 


10* 


9*,11*^ 


7^ 


4^ 


4 ,8 


4^ 




(10) 


(10) 


(7) 


(4) 

4 


' ° (7) 


(4) 



figures in this table are slightly more regular than the true figures. 

*Figuras in parentheses are best .estimates, which are weighted averages based- cn subjective 
judgments of the representativeness ot the data fro« the ^several sources. 

Sources: *Wargo et al. (1972); ^Gamel et al. (1975); ScES surveys; ^Urson and Dittmann (1976). 



32 



Table 12 » ^ 
Distribution of Participation in Title I by Size of District 



District 




Percent 

Partici? 


of ail Title I 
ants* 


Participation Rate . 
is Title I** 


Enrollment 




1971-72 


1972-73 


1971-72 


1972-73 


125,000 < 




16Z 


17Z 


21Z 


21Z 


35,000 - 125,000 


15Z 


12Z 


17Z 


13Z 


9,000 - 


35,000 


19Z 


22Z 


112 


12Z 


3,000 - 


9,000 


24Z 


24Z 


14Z 


12Z 


300 - 


3,000 


26Z 


25Z 


16Z 


16Z 


TOTAL:, 


lOOZ 


lOOZ 


MEAN: 15Z 


14Z 



Ratio of the number of Title I participants in districts of the particular 
size to the total number of Title I participants in all districts. 
/ \ 

**Ratio of the numberVf Title I participants in. dis lets of the particular 
size to the total number of pupils in districts of che particular size. 

Note: Data based on CPIR surveys (NCES, 1975, 1976). 
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A significantly smaller percentage of the disadvantaged students in 
8uburl)s were participating than in other communities, probably due t^ thelt 
schools* not l^ing sufficiently ImpoverishBd to qualify for Title I funds, y 
On the other hand» it might be argued that these particular students are 
not the targets 'for Title I, because they are attending relatively affluent 
schools: Title I is designed to aid schools in low*-income areaS that are 
financially incapable of supporting adequate compensatory sexrvices for their 
educationally disadvantaged pupils » not to aid :hildren in low«-income 
families directly. A fundamental redirection of Title I funds to compensate 
for the special educational 'needs 'arising fr6m ecdnondc disadvantage in a 
child's family would shift more funds to suburban school areas, according 
to these results. 

Participation by region . In the NCES survey for 1972-73, participation 
was reported for four regions of the country. Of children in the North 
Atlantic states and in the West and Southwest states, 14Z participated in 
Title I; in the North Central states, 11« of the children participated; 
however, in the Southeastern states, 21% of the children participated. In 
1972-73, the Title I expenditures per participant were highest in the North 
Atlantic states, about $300, and dropped off to $240, $230, and $215 in the 
North Central, Southeast, and West and Southwest, respectively. 

There was a significant interaction between region and school district 
. size in the Title I pa:rticipation rating.* In the North Atlantic and Central 
^regions, participation rate was especially high in the largest districts, 

but in the Southeast, participation rate was especially high in small 

districts. 

Other correlates of participation . The staff of the Compensatory 

Reading Study estimated the correlations of a large number of variables with 

vartlcipation in compensatory reading (Trismen et al., 1975). Although the 

overall participation rates in that study^ were higher than the national 

average, the rel£ftions of participation to other variable| are not clearly 

biased. Among their most interesting results are the following; 
✓ 

^ The total enrollments in the five strata of district size (see Table 12), 
in millions of pupils, were for the North Atlantic: 2.2, 0.5, 2.5, 3.6, 
and 2.3; for the Norxh Central: 1.1, 1.2, 2.7, 3.3, 4.2; for the South- 
Bast: 0.5, 2.4, 2.8, 2.9, 1.3; and for the West and Southwest: 1.4, 1.9, 
3.8, 2,2, and 2.2. Participation rate is the ratio of participants to 
total enrollment. 
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1. Boys tended to participate more frequently than girls (45Z va 35%) > 
and although no pretest comparisons between the sexes were reported, 
other research suggests that this corresponds to a slightly lower 
average reading achievement among boys than among girls, 

flv The average age of compensatory reading participants was slightly 
higher than their grade-mates, suggesting that 5Z, 17Z, and 22Z 

^ of 2nd, 4th, and 6th graders, respectively, in compensatory reading 
had already been held back a year in school. 

3; 'Among 4th and 6th graders in compensatory reading, 70Z haci had 
prior compensatory reading experience, and 25Z of the 4th graders 
, and 30Z of the 6th graders in compensatory reading had had three 

or more years of compensatory participation. 

Smmnary. Not all children with educational and ecdnomic disadvantages 
have participated in Title I programs. Although there are not recent data 
to related participation to needs, roughly half the children^ wttli severe needs 
were being served in 1968. Among blacks 'and in the large city sTchool districts, 
there was poor discrimination between those with and without needs in the se- 
lection of children to participate, or else teachers* judgment^ of need? in 
those groups were poor. Results of the Compensatory Reading Study also in- 
dicated a substantia? overlap, in 1972-73, between compensatory and regular 
reading pupils on standardized reading achievement tests. On the other hand, 
there is no questionnthat Title I participant^ tended to be educationally 
and economically disadvantaged; and the conclusion that some children with 
greater needs were not served while others with lesser needs were served^ must 
be viewed with extreme caution because of the fallibl^ measures of educational 
and economic need. (^/^ \^ 

There is no evidence that selection for compensatory education par- 
ticipation was being made on any grounds other than educational of economic 
disadvantage: all other observed correlates of participation were equally 
likely to be correlates of heed. One minor exception to this was the empha- 
sis on participation, of children at early ages; this exception is minor In 
that it does not in the long run exclude any individuals from participation. 

Finally, results based on the Compensatory Reading Study (USOE, 1976b) 
indicate that, in 1972-73, about 70% of the third of the children in Title I 
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funded schools who were both one or more years below grade level and par- 
ticipants in a free lunch program received compensatory reading assistance; 
however, a sixth of the children in non-Title I funded schools °also had the 
same needs, and 60% of them received compensatory reading assistance r Thus, 
it Is clear that Title I Is but one of several sources, formal or informal, 
of support for compensatory reading assistance. 
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Treatment Delivery 



. , Itocal school, districts are given the responsibility, under Title I, 
of selecting strategies for using the allocated funds as they deem best for 
meeting the specia^educatlonal needs of educationally disadvantaged children ^ 
in poverty afeas. They may, on the basis of needs assessment, choose to 
focus on a single objective, such as Improving reading achievement, 6r to 
attack a broader range of objectives. For the selected objectives, they may 
choose to implement any of a variety of treatm^l^s, such rs buying curricu- 
lum packages, hiring a reading specialist, or hiring teaching aides. In order 
to describe the range of activities succinctly, we shall iise two methods: 
fi^rst, a presentation of expenditures in terms of the formal categories 
use^ in various surveys and reports (Wargo et al., 1972; Gamel et al,, 
1975;^ NCES, 1975, 1976); and second, a series of 40 very brief descriptions 
of exemplary piji^jects described in reports of the It Works series (Hawk^ 
ridge et al., 1968, 1969; Wargo at al., 1971). The results of the surveys 
serve to convey the relative fre<;uencles of treatmegfts^'^ilellvered across 
the country; hqwever, they lack the derail to provide us with an idea of 
what Title I treatments actually consist of. The very brief project descrip- 
tions, on the other hand, at least begin to give an idea of what a Tltl§ I 

Eatment looks like. The list of descriptions can not be Interpreted 
quantitatively represencativo of the country, however, because the pro- 
te were fleeted as exemplary and they were selected by Informal 
sampling procedures. ^ 

Formal Categories 

There are- three- 44stlnct reasons for attempting to repor^ theVate- 
gorles of resourjces for which Title I funds have been used, even though 
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th^re iM no conclusive evidence about the relatfve eJ^ectlveness o£ . 
different tri/atment methods. Flrsjfc, there Is the need to know'wheth< r/** 
ttm ft^da are being used to meet defined " proBlems . For example, in Hew of 
the prdblem that many young pepi>le leave school without mastering tl^ basic 
•kill* of reading, writing, and laithematlcs , it Is Important to know what 
percentage of funds have been ustd for instruction in these basic skills. 
S«cond, there is the nqe<f to know vhnt emphsses have^ been in the past in 
order to decide on i/olicies o^ changing allocation strategies. If nearly 
all funds were already being spent on basic skills instruction, it would be 
meaningless to propose allocating a larger percentage to basic skills in- 
struction. Third, the act of obtaining and reporting this information serves 
a management function of communicating to J^e local decisionmakers the need 
to account for the expenditure of public ftmds. 
^ The allocation of funds by category for the yearls from 1965-66 to 
1973-74 are shown in Table 14. After the initial year (1965-66) in which 
funds were appropriated two months prior to the end of the school year-, 
the percentage of expenditures that were designated directly for ftstructlon 
has been fairly stable at about 70Z (.Ifsregarding the 1973-74 results In 
the KMC report, because they ire based on. only 5 state reports). Jhere has 
been. a steady decrease in expenditures for cgn^truction and equipment over 
the years, and the emphases in nonlnstruct^bnal pupil services have changed 
from health and food to counseling. So-called "fixed charges" have risen 
steadily from 5Z to 8Z. These Include, for>l<fimple, "retirement. Insurance, 
rent,^and Interest on current and short-term loans" (NCES, 1976, p. 105). 

Approximately 60Z o/^ ±e Instructloncl expenditures have been for the 
teaching of English language arts, Includl^ig reading. Another 15% has been 
spent for mathematics and natural science. TJie remaining 25X was spent on 
conklnatlons of subject matter that were categorized differently in differ- 
ent reports. The dramatic increase in expendl:ures for mathematics instruc- 
tion reported by KMC for 1973-74 is a function of ^he small sample size and, 
in particular, the fact that Mississippi, allocated 37t of its Title I ins true 
tlonal btipjis to mathematics that year. 

Breaking the expenditures down in other ways, it appear^ that from 
1971-72 trough 1973-74 about 65% of the funds were spent on programs during 
the school year and 15% on programs during the summer. .As pointed out in 
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tabU 14 

Tmtcmat tn^^itwm by CACtfocy ud Tmt^ 
Staff IMilMr* for i:M T<ti# T Twyf*?** F^r ^ 
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the ConpeMatory Heading Study (Al-Salam & Flynn, 1976)^ the costs per par- 
tlclpant-hour ttod to, be l&rger for sunnner programs. In f^ras of the agents 
of Inatxtictlon, about an equal number of teachers and teacher ifides were 
supported 'by Title I, funds during the i^e«ular school term, but a smaller 
proportion q£* teacher aides were used during the ^summer, at least in 1971- 
72 md 1972-73. Although there Is no information available on the r'elafive 
coatTeffectiveness op employing additional teachers versus teacher aides foi 
coppensator^, education, Hlatt K1977) has yeported.(l) that teachers who have 
kides working with them are generally more satisfied with their Jobs, but 
(2) 'that teachers tend to deploy teacher aides to.tasks^at do not maxi- 
mize the teaching. effectiveness of the team. She sug^s ted that teachersv^; ° 
ue instructed in the proper use of tea^cher aides as part of ' their training.^ 
In order to understand the nature of the: Title I contribution. to educa- 
tion, it would be useful to cgmpare the data in Table 14 to the amoupts 
spent from other sources for various^ categories of resniirce's. However, these 
data appear to be available only for federal pro grams .^^ Using the NCES re- • 
port for the 1972-73 school year, one finds that the Title I "low-income" 
program accounted for 41Z of federal aid to local education agencies that 
year. „The categories in which the Title I expenditures were relatively much 
higher thati other' federal programs were English language arts (44Z of Title 
I expenditures vs. 7% of othei^expenditures) , other basic skills (22Z vs. 
9X)', the pupil support services Of nonvocational guidance, health, attendance, 
and transportation (5Z vs. 2%) ,?^nd fixed charge^ vs. 2 AX). The func- 

tional categories toward which other federal programs were substantially 
mc^re targeted than Title^ I included food (42% vs. 0.6Z), vocational skills 
and guidance (13Z vs. 0.7Z), student subsidies (1.9% vs. O.IZ), non-textbook 
mterials (4.6Z V3^5Z)\ and construction and equipment (4.1Z vs 1.4%). 
Thus, the functj<^al profile of Title I expenditures, with its focus on 
basic skills instruction, is sr' st^ntially dlffferent from that for other 
federal aid to local education agencies. 

Project Descriptions J ' 

In order to supplement the information provided by>4he categotlzation 
of Title I expenditures, we have Included a set bf descriptions of exemplary 
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covpensAtory Vacation pro.iects. The projects or models described were 
developed from a variety of funding sources and with a ^variety of objectives. 
They have In common that at one dme or another they have ahown evidence of 
successt although .10 methods have proven to ble unequivocal successes. There 
are no data on the relative frequency of projects like the ones de^rlbed. 

* The descriptions are bas^^d^ primarily on those given by the authors of 
the It Works series summaries. Insofar as possible, we have Included (1) 
the site and originator ^f each project; (2) Its level of structure and 
orientation; (3) Its student : teacher ratio; (4) the primary operational 
objectives of the project; (5; target age-group; and (6) the Inteislty 

and length of the child's participation. We hope that this sec of descrip- 
tions %ill provide readers with a basis for Interpreting the meaning of 
abstract terms such as "participation rate" and "compensatory reading 
assistance". The list Is ordered approximately In terms of Increasing age of 
the target group. 
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Ingant Education Rm— rch Proj€ct 8- 
(VuhinttOQ, D.C.) (Scbacftr) : 
UBCCTuccurftd turorlng pfofr** for 1 hour 
p«r d«7 In thfl child's hoM. Targatt v«r« 
chUdrm b«cw««n Cha a«a« ot 15 and 36 
■oaths. Toys, isms, booka, and verbal 
atinilatlon wa a uaad to ataballsa and 
impwm IQ tMC acoras. 

MoAar-Child fiom Protraa (Traaport, Nav 
York) (Uvanatain): a Modarata^y r^ruc- 9. 
turad pro a in which a ''Toy Danonatrator" 
ptom tmd Vftrbal intaraction batwaan aothara 
and thai? 2-3 yaar ola chlldtan during 2 
haXf*ho«r aasaiona par vaak for a yaar. 
Ala vaa to laprova XQ taat parforvaaca. 

yarry Fraa'chool Projact (Tpiila-itl, Hlchi- 
$an) (Valkart) : an uaatructurad activity 
castai (plus a 90*«lnuta hdaa vlalt onca a 
vaak) ualng "varbal boabardaant" in highly 
itructurad thaaatic unlta for 15 hours par 10. 
vaak ovar 2 yaara with futictlonally ratard- 
a<i 3- and 4*yaar olda. Ala vaa to improva 
parforaanca on IQ taata and raading, 1 . 
guaga, and aath achiavaaant taata. Uaad 
4 apaciaXizad taachara vlth 24 childran. 
Thla ia rilatad to tha Cognitive Curricu- 
lua Follow-Through aodfl. 

Praachool Proiraa (Fraano» California) 
(Forraatar) : a prograa uaing taachar aldaa 
and p#ranta (a tudant; teaching parsonnal 
ratio 4:1) to iaproi^ tha language abili- 
tlaa of 3- to 5-yaar olda, primarily from 
Spanlah-traaklng faalllaa, during "-hour 
dally ae.aiona. Used typical pre^t. tool 
aaterlala . 

Praachool Program (Oakland, California) 
(Watera): a prograa ualng a team consist- 
ing of a teacher, a teacher aide, and a par- 
eat vlth 4ach 15 children of agea 3 to 4, 
four hcura daily for a yaar, in teacher- ^ 
directed aisall-g^oup activitiaa vlth indivi- 
dualised liamlng unit aeriet. emphasising 
language skills, i in order to Improve IQ 
test parforaanca. Included many enrichment 
activitiaa and field trips. 

Academic Prescho ol (Champaign, Illinois) 
(Baraiter and Engaimann) : a highly atruc- 
turedc le^-directed (atudent: teacher 
ratio of jil) tWo-hour-par-day prograa 
alaed to improve the rHadlnaaa of 4- and 5- 
year olds who v#re retarded in reading, 
language, or math. Thla Is related to the 
Direct InatructloTi Follov-Through model. 

Aaeliorative Pr^whool Program (Champaign, 
Illinoia) (Karnes): a highly structured, 
teacher-directed (student ;teacher ratio 5:1) 
prograa in wMch 2 houra per day were spent 
xn preschool, Chen 1 hour per day in kinder- 
garten. Aim waa to improve readineas of 4- 
year-olds in readir';, language, and math. 
A special game format was ^'sed. 



Dlagnostically Baaed Curriculum (Blooalngton, 
Indiana) (Splckar): a teache directed 
(atudent: teacher ratio 15;1) behavior modi- 
fication prograa uaing dlagn la of problama 
in language, concepta, and fi a motor devel- 
opment in a ycar-locg, 4-hour-^ r-d>y 
pvogras with 5-year-olda to Improve IQ and 
language perforaance. Activities vera 
ali^lar to a regular kindergarten. 

Learning to Laam Prograa (Jacks'mvilla, 
?iorlda) (Sprigle)* aaltnly child-directed 
aet of activitiaa for 3 houra per day for 5- 
year-olda, uaing toya, gaaaa, and books in a 
atructurad aequeace to guarantee auccasaea 
for all chUdran. Tha aim vaa iaprovaaant 
of IQ teat performance. Short (15 alnute) 
aaall-group (student : teacher ratio 3:1) • 
teacher-directed sesalona ware Interapevaed 
in each session. 

Project Bre a kthrough (Chicago, Illinoia) 
(Tracy): a coabination of highly structured 
"Bdlaon Raaponslve Environment" aeaalona 
of 1-1/2 ho-jra daily. Including "Talking - 
Typewriters", and intensified social aervlcea 
for weXfare parenta, alrna^ at Improving the 
performance of 4- to 5-year-olda on IQ and 
readlneaa teata. Uaad a Laboratory Super- 
viaor in a varying ratio (1:1 to 10:1) with 
children. Thia is related to the Basponaive 
Environment Follow-T^ ough Model. 

Prolect ^JatlY Push (Buffalo^ New York) 
(District staff): a low-structured, 
child-directed prograa of activitiaa, four 
houra daily for a y<iar, using typical pra- 
achool practicea to improve the perforaance 
of 4-year-olda on raadlncsa taata. Uaed a 
vlaitlng t-sachar, home-school coordinr t, and 
teacher aidea with a student :teachlnf ar- 
aonnel ranio of 15:1. 

PS 115 Alpha One RaadinK Program (New Tork, 
N,Y.) (Relaa)l a moderately atructurad, gama- 
orlented program, two houra daily for first 
gradera, aimed at improving reading skills* 
Baaed on a commercial self-contained kit of 
leaaon planr and materiala to be uaed by 
the regular teacher. 

Language Stimulation Program (Auburn, Alabama) 
(Carter): a highly atructurad language im- 
provement program, four hour% per week for 
ten veeka, for first gradera, ua^ug the Paa- 
body Language Development Kit inataad of 
regular language inatruccion. 

Prograaaied Tutorial Reading Projec (Indian- 
apolis, Indiana) (Ellaon) : a highly struc- 
tured reading Improvement program, one half- 
hour daily for firat gradera, in which haavily 
supervised paraprof easional tutors followed 
a tightly orogravBed sequence of "lesson 
plans" In one-to-one tutorial sessions. This 
became one of the b original PIPs. 
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(KUtMiikM, tflflcoiuiln) (Dlsrrlct staif): 
•sp«rl«ac«d epMch £h«r«pl«t« vorkad ylth 
groups of 6 to 8 first'* aad socond-srsd^rs 
with lov oral Uagnaio facility, thraa 
hours pat waak tor 15 waaka, la ordor to 
laprova fvarbal JLanguafe skill* 

16. garlT Childhood ?ro1«ct CHaw York, N.T.) 
(Dautseh) : a Mdarataly structurad pro- 

traa aaphaalsisg salf-pacad, ladlviduallz«d» 22. 
aad saall*s>'otsp iu true t Ion with auch faad- 
hack aad'vith crest Iva draastlcs, for flv« 
hours par waak orar fiva yaars fro« pra- 
kiadarisrtan to third grsda. Ais»d co i»- 
prova Isaguafs sod concept skills, than 
aach sad scim c a si^ll ss> Usad s collega- 
graduate assistant teachers vith s regulsr 
tsachar in aac)> class. 23. 

17 . Hslsbsr Basding Prograa for K . :d.csn- 
Aasricsn Children (Los i^(geXis» California) 
(Ossscs) : s loir-^tructurad program of self- 
directed activities esphsslsing orsl and 

nrritten language aiaad at laproving reading 
and language perforaance over a five-year 
period froa prekindergarten to third grade. 
Used parent volunteers to reduc«« student: 
teaching personaal raelo belov 30*1* 

2&. 

18* Augaented Reading Project (Poaona, Califor- 
nia) (District staff): a coabinatlon rena- 
dial readint, and coaaunity activation pro- 
graa for children In grades one through six» 
mostly froa Spsnish-spesklng fanillaa. 
Counselors, psychologists, renedlsl reading 
specialists, s "helping tescher", end 
tasoher sides vere employed to aaslst the 25. 
regular teacher. 

19. More Effective Schools (New York, N.Y.) 
(Fox) : a laajor reorganization ol tSachlng 
of elementary school atudenta, emphaalzlng 
language akills and reading, heterogeneous 
student grouping, aodersts stiident-tescher 
rstlo (15:1 to 22:1), remedial, tutorlsl, 

and enrichment instruction, and encourage- 26. 
agnt of teachera to use innovative techniques; 
aimed to Improve resding schlevement. 

20, P ro ^ set Conquest (Esst St. Louis) (Spsnn) : 
taschars received up to a year of apacial 
training In mathoda of diagnoais and 2reat- 
mrat of reading problems, Aftervsrds, 
pupils in grsdes 1 through 6 irith resding 
problems were Identified and assigned to 
clinics or *'other classrooms" for 1-1/2 to 

3 hours per week for small-group (atudent: 27. 
teacher ratio 6:1) Inatructlon by reading 
teachers using s variety of materials. This 
became one of the 6 original PIPs. 



Project MARS (Pominster, Msssschusetts) 
(Ellis): pupils in grades 1 through 4 
who were diagnosed as having rssding problems 
received 3/4 hour of remedial instruction 
dslly from reading specialists (studsnt: 
teacher ratio 6:1) ualng a variety of 
aateriala. Aim was to rsduce the discrepaacy 
becvaen their ability and parformaoce in 
reading « 

Self-Dlrectlve Dramatization Frojact (Jollet, 
Iliinole) (Carlton end Moore): pupils in 
grsdes 1 to 4 workad ia sa unstrrtcturad small 
group sad draastisad stories they read por* 
tfsyittg self-chosen characters, 3 ta 5 tiaas 
par weak f r 7 aonths, in order to iaprova 
reading a wwsnt. 

Project im (Hartford, Connecticut) 
(Fsrsaise/s pupils from Isrgely blsck inner- 
city elamsntsry schools were b*-ssd to sub* 
urban white achoola wfaare they ent^ed classea 
in eaall nuaibaTS. They were accompanied by a 
teacher aad an aide who assisted the regular 
ataff of the auburban school in order to Im- 
prove the IQ, readiness and schievemsnt per- 
formance of the bus^ children through chelr 
regulsr ttsching methods. 

School snd ilome Progrsm (Tllnt, Michlgsn) 
(Smith) : ts^*chers assigned home reading 
exerciaes and provided guides to parents on 
how to aupport their children* a leaminS» 
every evening for five montha, for elemea* 
tary achoo?, atudenea. In order to Improve 
reading achievement « 

^ ^ter School Study Centers (Raw York, N.Y.) 
(Dlatrlct staff): pupila in gradea 2 through 
6 volunteered for up to 2 houra dally remedial 
reading inatructlon between 3 and 5 p.m.. 
In which teachera tutored atudenta Indivi- 
duals or In amall groups using the SRA 
Reading Laba and other mater iala aimed to 
IfflprovQ reading achievement. 

Intensive Reading Instructional Teams (Hart- 
ford, Connecticut) (District stsff): pupils 
froa grsdes 3 through 6 with reading problem^, 
spent 3 hours dally for 20 weeks s struc- 
tured program using s vsrlety of scrstegies 
to Incresse resding schlevement, A resding 
specialist workad with two reading teachera 
and focused on three srsaa: decoding, 
baaal reading, and individual motivation. 
This became one of the 6 original PIPa. 

Homework Helper Program (New York, N.Y.) 
(Deering): In this program, needy but abla 
high school students were paid to tutor 
falling pupils In grades 3 through 6, 2 to 4 
hours per week after achool for 5 mortths, 
In order to improve reading achievement. 
Both pupils and tutors gained significantly. 
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2$. Af f moon dUl •nd Enricha>nt Progf « 34. 
(Buffalo, N€V Tork) (District staff) and 
Plus Pi sra» (Buffalo, Nav York) (Dia- 
crlct staff): tvo rastdial raadlnf t\d 
MChaMtlcs protrsM for pupila In gradas 
3 ehrouih 8 (1 rhrou|h 8 for Plus Progras)* 
In which rafular taachats taught 1-1/2 
hour aaaaiOQS aftar achool daily (axtra 
taachars cau^t 1-1/2 hour aaaalona during 35 
tba achool da? in tha Plus Prograa) , with 
a 6:1 pupil: taachar ratio. 

29- Famald School laaadiation of Laaming 

Dlaordars Progr.o (Loa Asfalaa* California) 
(Faahb >ch) t pupils in gradas 2 through 8 
of avaraga Intalliganca but lagging achiava- 
aaat vara buaad to a laboratory achool for 
6 hours of daily instruction for ona yaar, 
Highly atructurad, broad-baaad, indivl- 
duallzad instruction by spaclally trained 
taachars (atud^t: taachar ratio of 5:1) 
vaa daaignad to Inprova raading, language, 
and aath achiavaaant. 

30. Dlatnoatlc Raading Clinics (Clavaland, 
Ohio) (Davis): pupils in gradaa 4 
through 7 balov axpactad raading laval 
but not with **low IQs vara glvan an in- 
dividual l-hour-par-day highly atructurad 37, 
raaadlal raading sasaion ^th a raading 
spaclaliat, apaach thararl«t, paychologiat» 
social «orkar» or aida» laating 3 to 5 
ttonths. In ordar to iaiprova laadlng 
achiavaaant . 

31. Elaaantarv Reading Centars (Mllwaukaa, 
Wisconsin) (District stsff): raading can- 

^ tara with apadally trained raiding taachars 
vare provided in achools so that pupila in 33. 
gradaa 4 through 8 with reading problaaa 
could receive aaall group (studant: teacher 
ratio 6:1) Instruction one-half hour daily 
to deal with their indivldusl probleas. 

32. tafarette Bilingual Center (Chicago, 
Illinoia) (Picchiotti): pupils in grades 

6 through 8» who aa recent ianigranta apoke 
Spaniah, were initially taught in Spanish, 
with a gradual transition to English over a 
period of 1 to 3 years, Anglo pupils 
learned Spanish and participated aa nodelA 39. 
and tutora« 

33. Comunication Skilla Center Project 
(Detroit, Michigan) (Thomas) ? pupils in 
gradaa 2 through 11 were diagnoaed for 
reading probleaa and given individual 

or aaall-^group inatruction at clinica or 
in apaclal classroons, about 2 hours per 40^ 
week (1 ho'ir dally in suaner sessions), 
by special reading teachers aided by psy- 
chologist, social therspists, snd Isy aides. 



l Unadial Reading Laborafcoriea (El Paso, Texas) 
iSteimagal): pu;il8 In gradaa 4 through 12 
diagnoaed by counaelora aa having reading 
probleaa were given highly structured indivi- 
dualised instruction, one hour daily for 8 
nontha, by lab teacher a, half of whoa were 
credentialed reading apeclallsts. 

Higher Horixooa 100 (Hartford, Connecticut) 
(White) : 100 ninth gradara entering high 
school aore than a year behind in reading 
we *e invited to ente* a year-long *'achool 
within a achool'* in i4iich Intanaiva language 
training was included in all aubjacts 4 
houra daily« A counaalor worked full tlaa 
with these 100 atudenta. 

P roject R-3 (San Joaer, California) (Diatrlct 
ataff): ei^th and ninth gradara who were 1 
to 2 yeara behind in reading or aath were 
giv«n structured instruction eaphasizlng 
"readinaas, relevance, and relnforceaant"* 
during 3 aoming class perioda for a year, 
Raal^forld probleaa were included in the 
curriculua, and structured field tripa were 
taken. This becaaa one of the 6 original 
PlPa, 

Suaaar Junior High Schoola (5ew York, K-Y.) 
(Fox) : pupila in gradaa 7 through 9 who were 
behind in reading or who had failed a courae 
were given highly atructurad inatruction* 
1-1/2 houra daily for 4 waaka during the 
auaaar. Teacher aidea used by the progria 
were high achool graduates froa lapoverished 
conaunltiaa who ware In need of financial 
assistance to continue their education. 

College Bound Prograa (New York, ».Y,) (Hlll- 
fPon) : pupila in gradaa 9 and 10 iflth good 
attendance but soaawhat lower than aversgc 
schieveaent (on the sverage) were aotivated 
to puraua a college prep curri'rulua and pro- 
vided with intanaiva individualized auonar 
instrucCion, 3 hours daily for 6 weeka, to 
assist thea in realizing thia goa^. Local 
colleges were persuaded to connit theaaclvea 
to accepting and providing financial aid to 
a percentage of the participanta. 

Expanded langxiage Arte Program (Buffalo, N,Y.) 
(Heintz): extra teachera were hired to re- 
duce the pupil: teacher ratio to 10:1 in 
language arte claaaea. 1 claaa per day, in 
grades 7 through 12. Teachera were heavily 
supervlaed, and audiovlaual aateriala were 
used extensively. 

Sunaer Upward Bound (Terre Haute, Indiana) 
(District staff): high achool atudents with 
college potential apent all day daily for 8 
weeks in each of y Gunners on a college cam- 
pus, in a highly structured innovative pro- 
gram of aclemic and ext acurricular activi- 
ties daaignad to incra^ae their aapirationa 
for and likelihood of success in a college 
education. College students were used as 
:ators. 
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Hodels for projects discussed at length by M, McLaughlin (1971) were 
Besearch for Better Schools, Inc., which produced IPI, a carefully sequei 
program of individually prescribed Instruction designed for general student 
use but used in many Title I schools; and the Demonstration and Research Cen-* 
ter In Early Education (DARCEE) in Nashville, Tennessee, which developed pro- 
jects emphasizing the involvement of parents in the teaching of their children* 

The Compensatory Reading Study (Trismen et al., 1975) recorded several 
variations of methods of admluistering compensatory reading instruction, some 
of which are shown in Tables 15 and 16. The Compensatory Reading Study also 
categorized overall reading programs into 11 clusters based on combinations 
of attributes. However, they did not report which of the clusters were more 
frequently aimed at compensatory target groups of children. On the other hand, 
the program characteristics closely related to Title I vs. other funding sour- 
ces were use of audiovisual equipment and empliasis on basic reading activities ^ 

There are, of course, other sources of exemplary project descriptions. 
Over 200 one-page descriptions of "Education Programs That Work" have been 
published by the U.S. Office of Education (FWLERD, 1976). Also, the NACEDC 
has included exemplary project descriptions in each of their annual reports 
to Congress. 
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Summary 

The lack of centralization of design of methods in the Title I «aysteiif 
has accomplished the goal of covering a wide range of activities to be tried. 
The treatments can be characterized as particular combinations of functions, 
agents, subjects, environments, and activities. 

Functions ; increasing cognitive abilities, increasing the rate of 
achievement, improving the self /ideal Image, and improving attitudes 
toward school work. 

Agents ; (regular) teachers, teaching aides, parents, paraprofassional 
tutors, peer tutors, peer models, reading specialists, speech thera- 
pists, counselors, social workers, and computers. 

Subjects : primarily reading, language arts, and mathematics, but also 
natural science, social studies, cultural enrichment, and other non- 
basic skill areas. 

58 
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Table 15 

Participation and Costs for Various Types of 
Compensatory Reading Activities, Grades 2, 4, and 6, 1972-73 





Average 

Class Size 


Percent of 
Children In Sample 


Cost 
per rupix 


In separate classrooms 


26 


23% 


$148 


In mixed classrooms (with 
regular reading pupils) 


27 


20Z 


$152 


In small » special reading 
groups (separate) 


8 


2Z 


$664 


In small* special reading 
groups (mixed) 


12 


2Z 


$580 



Note: Data from the Compensatory Reading Study National Sample of 226 schools 
(USOE, 1976). 



Table 16 

Percentage of Schools Using Various 
Agents for Compensatory Reading Assistance 



Schools with Schools with Schools with 

Title I Funded Title I and other non-Title I Fur.ded 
Comp. Reading Only Funded Comp. Reading Comp. Reading Only 



Use of volunteers 








in the compensatory 




48% 


5A% 


reading classroom 


45Z 


Use of pupils as 
tutors 


53% 


32% 


40% 



Not^: Data from the Compensatory Reading Study (Rubin et al., 1973). 
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^ EavlronBicnts ; (regular) classroomy **labQratory'% library, special 
claasroom, hone, iield trips, college campus; child centered struc- 
tured, open, small groups, and individual interactional 

Activities : (regular) lessons, kits of special lessons, audiovisual 
ejrperiences , games and toys, dramatics, paying children to leam^ 
parent training, busing, tutoring, and counseling/* 

Other pupil services, such as health, food, and clothing, have accounted 
for a small and decreasing percentage of the Title I effort. Finally, about 
1.3Z of Title I expenditures have been for the purpose of preservlce and in- 
service training, which has included the large majority of teachers and 
teaching aides providing compensatory education* 

Although the methods have varied, the primary focuses of Title I pro- 
JcK:t8 have been on directly improving the reading and other language skills 
of children in the primary grades. This focuii has increased over the decade 
of Title I operation. 
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Evaluation Reporting 



Annual evaluation reports are required In Title t. These evalfiatlon 
reports were Intended from the beginning to provide continuing checks that 
the funds were being used to help children (M. McLaughlin, 1975). An Impor- 
tant component of the evaluations has been the measureoient of the Improve- 

" ment of children's performance as a function of participation in compensatory 

education programs.. National summary evaluations (USOE* 1970; Glass, 1970; 
Wargo et al,, 1972; Planar, 1973; Gamel et al,, 1975; GAO, 1975-, and Thomas 
and Pelavln, 1976) have been based on aggregations of these local evaluation 
reports. The information needs that the reports of evaluations might serve 
are discussed in a companion doctmient (McLaughlin, Gilmartln, and Rossi, 
1977). 

The unanimous opinion of Lhose who attempted to aggregate the reports 
to present a national picture is that evaluation reporting has been fat less 
than adequately implemented. We have discussed in the companion document 
many specific problems in evaluation and will not repSv^c th^ here. 

In the case of the national surveys of local school districts in 1967-68 
and 1968-69, onJ,y about 7Z of the sampled districts provided usable data on 
program effectiveness. In their analyses of state reports, Wargo et al. 
(1972) found that out of the 91 reports for 1969 and 1970 (combined) only 
24 reported achievement data that were "possibly representative of their 
state," and only V of these ppsented data in such a way that they co^dd ^e 
combined across states. Without common guidelines, states had developed 
many creative ways of presenting their results, and only the presentation 
of average grade-equivalent gains occurred frequently enough to warrant 
aggregation. That, it has been pointed out by a number of authors, is 
unfortunate because of the distortions that can occur in interp-reting 
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grade-equivalent gains.* In its analysis of 26 state reports for 1972. the 
Planar Corporation (19.73) found 14 of th| reports to provide presentable 
data. In a major study of the evaluation reporting syt.tem, Gamel et ^1. 
(1975) analyzed achievement data from 187 state reports for the peri6d 
from 1971 to 19'74. Only 64 of these were evaluated as either representative 
or only "possibly biased." Of these, 27 reported reading achievement gains 
that were sufficiently similar to warrant combining the results; average 
monthly gains were reported, however, in only 16 of the reports. As in 
Wargo*8 analysis, Gamel et al. (1975) found grade-equivalent gains to be the 
onj.7 frequently used metric. An important conclusion that Gamel et al. 
(1975) reached was that state reports had not Improved over the period frcm 
1971 to 1974. Thomas and Pelavin (1976) extended the previous analyses by 
considering how conclusions might be changed if different criteria of "data 
adequacy" were used. Starting with 283 reports, they compared an initial 
sample of acceptable reports, essentially the same as Wargo's and Gamel' s, 
with (1) an extended sample including about 5 extra state reports per year 
from which inferences could be made, (2) a high-quality sample limited to 
about half of the reports is the initial sample that were judged to be most 
likely to be representative, and (3) a longitudinal sample of states with ^ 
adequate data for all four of the years 1971 through 1974. They found that 
results were essentially Ae same using any of the samples. ^ 

In response to the difficulties that had been pointed out in using the 
local and state evaluation reports to construct a national picture of Title I 
effectiveness, the Congress included in the Education Amendments of 1974 a 
request for improvement; subseque ^y, USOE contracted with KMC Research Cor- 
poration to produce several standard evaluation models that would be feasible 
for local school districts to Implement. USOE also contracted with educational 
research organizations across the country to provide ten regional technical 
assistance centers to help improve evaluatidnc and arpecif ically to help 
Implement the RMC-produced evaluation models. In 1977, these -flodels are in 
the process of being adopted in many states and may be expected to improve 
the ability to aggregate local evaluations into a national evaluation of 
Title I effectiveness. 

*A grade-equivalent score is the grade level for which the score is. typical 
(e.g. 4.5 means typical of a student in the fifth month of fourth grade). 
A gMde-equivalent gain is expressed in terms of 8"de-equivalent months 
gained per month in school or grade-equivalent years gained per school year. 
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Effectiveness 



Overall Effectiveness 

In Its FY75 annual evaluation report, the U.S. Office of Education 
stated that "the evidence Is no«r mixed whereas In prior times the only evi- 
dence available Indicated that disadvantaged students had not Improved or 
fell further behind" (USOE, 1976a, p. 94). Behind this rather weak* statement 
of positive prdgram effects lies the content of tens of thousands of pages 
of reports by reputabl^ evaluators over a ten**year span. Some reports have 
Indeed indicated the existence of positive e^^cts and othei^ negative, and 
nearly every report has ackovledged the existence of severe problems. In 
l^cqulrlng Interpretable data sufficient to answer the question^ 

The measurement of effectiveness of Title I has In almost every case 
Involved scores on ability and achievement tests taken by participating 
children. This, lil addition to the Identification that the appropriate 
children are participating (discussed earlier). Is the essential outcome 
sought by the program. Whatever the oth«r effects of Title 1 are, they are, 
according to the lav, of secondcry* Importance to the goal of helping children 
(In low"income areas) having difficulty with school to do better^in school. 
There have been frequent arguments that ^hlevement tests are sensitive td 
only a subset of the ways In which children can do' better In school, omit- 
ting such factors as Improved attendance, not dropping out, greater Interest 
in holastlc pursuits, and Improved self*lmage. However, there appears to 
^ 1 general consensus that these factors are more important as means to the 
e^ f Improving ' ^nltlve achievements Generally, the results of studies 
that have meas ed both affective and cognitive Impact have produced amblgu-* 
ous result*- In Pro;|ect LONGSTEP (Coles et al., 1976) and the Follow- 
Through Planned Variations Study (Anderson, 1977), affective and cognitive 
gains appeared to be positively related, but in the Compensatory Reading 
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Study (Tridmen et al., 1975), attitude and achievement scores tended to be 
negatively correlated (+.13, -,49, and -,A6 in grades 2, 4, and 6, respec- 
tivclyX. Other sources of relevant data are discussed in a companion volume 
(McLaughlin, Gilmartln, and Rossi, <1^77) t 

In a broader context in which one considers the motivations of the many 
designers and supportfet;s of the original legislation -and the program's con- 
tinued operation, direct impact on children's performance in school may be 
only one of several forms of impact of Title I. That law and program also 
serve to (1) redistribute the resources of society generally to the people 
most in need, (2) add to the total income of poverty areas, in the form of 
teaching aide employment, (3) provide further federal leverage to achieve 
national goals such^as equality of opportunity for all ethnic groups, (4) 
focus a larger percentage of society's resources into education, and (5) 
focus tne research and development activities of the education sector on 
particular problem areas. None of the studies reviewed has clearly addressed 
any of these goals, and it is beyond the scope of this study to investigate 
them, however important they are. 

Various studies have used various measures of achievement gain. Excerpt 
for the -Compensatory Reading Study and the PIPs evaluation, all the studies 
reviewed relied on whatever test happened to have been selected by the local 
district in order to measure achievement. Although the Anchor Test Study 
(Loret, Bianchini, and Vale,' 1974) produced tables relating eight major test ^ 
series in 1975, the problem of aggregating gains across districts remains com- 
plicated, because no standardized test measures exactly the skills taught in 
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any particular classroom. In order to solve this problem in the long run, 
it will probably be necessary to complicate evaluation further by allowing 
each teacher or school to use the most appropriate test it can find or con- 
struct, and then to compare both the extent to which children gain on that 
test and the differences in measured objectives between teachers. Such compari- 
sons can only be meaningful in terms of an acceptable global taxonomy of 
eductional objectives. 

One particular question about the definition of impact concerns the de- 
cision by USOE tc focus its evaluative resources on the particular skill area 
of reading. It could reasonably be argued that compensatory education is 
likely to be more effective in some subjects than in others. For example. 



prellvdnary results from the Impact evaluation of ESEA Title VII (the Bi- 
lingual Program) (American Institutes for Researchi 1977) found it to be 
effective In mathematics but not in langxiage arts,^* However, there is a gen- 
eral consensus that the ability to read is the singliB most important cogni- 
tive sldll that schools in our society are responsible for imparting, and 
as long as tliere ari many children who are only mar;ginally learning to read, 
it^ seems reasonable to evaluate the overall impact of Jitle I in terms of its . 
effects on reading achievement. The focus on a single subject area for 
evaluation was dictated by the need for an intensive investigation of an 
area narrower than all of Title I in order to produce interpretable impact 
data. 

Nine studies that have to some extent addressed this question are listed 
in Table 17. The conclusion reached in each is presente;^, along with a • 
description of the data base and a listing of th4 most severe problems pre- 
venting acceptance of the conclusion. The most dramatic aspect of the in- 
formation presented in Table 17 is that no studies have been completed that 
provide an unequivocal answer to the question of how much effect Title I has 
had on achievement s Thus the situation is not one in which there are some 
valid studies that f^und positive results and some that found negative re- . 
suits. There is nc starting point of a single study with a definitive answer. 
That does nbt imply, however, that the studies have nothing valid to say about 
the general level of success of compensatory education programs. 

In this situation, a proper strategy is to list possible answers to the 
question and evaluate which are more likely to be true. In the area of read- 
ing achievement, the following are seVen p^pssible answers. 

1. At the end of a year's compensatory instruction, mpst students are 
performing at levels superior, to other children of their age. 

2. At the end of a year's compensatory instruction, most students are 
performing at levels typicar^for children of their age. 

3. Students in compensatory programs tend to be closer to the'ir peers 
in achievement at end of the instruction than lat the beginning. 

4. Students in compensatory programs tend ^ to be about as far behind 
their peers at the end of instruction as at the beginning. 
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Bvldenct Concarolng the Cea«ral B££fctlvenM« 



of CoapenMtory ^ucatlon 



Study 



TEMPO 

1^68 USOE survey 
196^ USOE survey 



' Planar exaalna- 
tlon of state 
reports 

AIR exanlnatlon 
of state reports 

RMC exanlnatlon 
^ of state reports 



SRI exanlnatlon 
of state reports 



1975 GAG report 



Compensatory Read- 
ing Study 



Measure of Success 



Conclusion 



Validity* ' 



Moat Serious Defects** 



School reading testing In 1966-67 
vs. In 1965-66 (whole classes) 



Achleveaent In gains per Month 



Achleveaent In Mlns per ■onth^ 
and teachers' reports of laprove- 

nent'.'- ^ - 

/tKlevewent In gains per aonth 
relative to noras (19r2) 



AcUleveaent In gains per aonth 
relative to noras (1969-70) 



Achievement In galnH per aonth 
relative to noras (1969-74) 



Achievement In gains per aonth 
relstlve to norms (1969-74)^ 



Achievement In gains per month 
relative to, noras (1974-75) 



Reading test scores, coaparison 
between cospensatory and noncoa- 
pensatory groups, posttest cor- 
rected for pretest 



Decline except In bottom 
decile 



iess than 1.0 aonth >ar 
aonth 

Less than 1.0 aonth per 
aonth, but tsAchers 
reported positive gslns 

Ab^ut 1.0 aonth per aonth 



Between 0.7 and l.A aonth 
per aonth 



As great or grater than 
1.0 aonth per aontb 



Cs great or great^r^jlian' 
l7b aonth per aonth 



Less than 1.0 aonth per 
aon^'h 



No subsi:antlal or algnlf* 
leant difference 



Clearly^^i^alld 

Probably Invalid 
Probably Invalid 

Cleaily InvaUd 
Probably Invalid 
Probably Invalid 
Probably Invalid 



Clearly Invalid 
I 



nte 

/ 



Sasllf unrepresentative ssa|Ae; Invalid 
criterion (coaparison with previous year 
without correction); did not identify 
psrticipating children 

t 

Fewer than lOX of dlatrlcta reaponded with 
adequate achlevcaent dats 

Fewer than lOX of districts responded with 
sdcquata achieveaent data; questionable 
validity of tearher judgaents 



itonable 
interi»'5l validity 



State report a have unknown bias«*s; s*^l 
nual>er of adequate reports; aggregation In 
teraa of grade-equivalent scorri relative 
to^publiahed noras 

State reporta have unknown biases; sfwll 
nusAier of adequate reports; aggregation in 
teras of grade-equivalent scores relative 
to published noras 

State veports havfe unknown biases; saall 
nuaier of sdequate reports; aggregation in 
te.iM of grade-equivalent scores relative 
to published noras 

State reports have unknown biases; saall 
number of sdequate reports; aggregation In . 
teras of grade-equivalent scores relative 
to published norms 

Saall, unrepresentstive sample; aggregation 
in teras of uncorrected months gained; coa- 
parison to published noras In teras of grade 
equivalents 

Inadequate statistics! analysis of the data 
(aodel for pretest- posttest relations, treat- 
aent of proble<pa|with claas aean-)) 



author', suhjecuve .v.lu.tlo„. The reader .e. -"^eren. overall' .t.njara. J-.--;;^.";^.;;;.:^- ^,^^H"rt^^^%3"r:a^V^'v:u^^y'^''° 
atudy. the Planar atudy. and the 1975 CAO atudy Hiive tha weakeat data baaea and -oat queatlonable a.miy, e 

tlian any of the other atudlea. .erloua defecta In th» atudlea, but are the uoal 

**The». d*f.Qt. were nearly alw.ya noted by the authora of the r.-p«ctlve report.. They are not the only aerloua 
serious in this author's opinion. ^ 
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5. Students in compensatory programs tend to fall behind other p'adents. 
but not as fast as If they had received no compensatoxy instructions. 

6. Students In compeusatpry-prd grains tend to.^all behind other students 
at the same rate they would without compensatory instruction. 

7. Students in compensatory programs tern to fall behind other students 
faster than they would without compensatory instruction. 

No studies that were reviewed provided data that would support the 
first second, or seventh conclusions. The fourth alternative answar has 
the greatest support, in the form of the Compensatory Reading Study's find- 
ings of no substantial differences between Compensatory and noncompensatory 
groups (Trismen et al. , 1975). The analysis of Annual State Reports by SRI 
suggests that the third alternative answer may be plausible; on the other 
hand, the USOE surveys for the 1967-68 and 1968-69 school years, the AIR 
reanajysfs and S3mthesis (Vargo et al., 1972), and the 1975 GAO eport tend 
to indicate the fifth or sixth alternative. Between 1965 and 1976, expecta- 
tions have changed from the second of the seven levelb of success to the 
fifth. If students are shown to fill back not as fast as would be predicted 
by their pretest percentile level, t* u the project is viewed as effective. 

One is tempted to compare the validity of studies that had alternative 
findings in some quantitative way to arrive at a conclusion based on "the 
preponderance of evidence". However, that procedure would be based on a 
confusion between "validity" and "reliability" of results. The reliability 
of a study is the extent to which replications of the study (e.g*, on a dif- 
ferent saiq)le of students) would pi^oduce the same results. The validity of a 
study is the extent to which generalisations sed on the data are true. In 
general internal validity refers to validity with respect to statements about 
the sample studied; external validity refers to validity with respect to gene:aL 
izations to a larger population. Of two valid studies, one based on a sample 
of 10 school districts and another based on a sample of 100 school districts, 
one would correctly select the concluel'^n of the latter study in caoe of con- 
flict, because the greater "reliability" of its results — i.e., the smaller 
likelihood that the results would be different if a different sample oi the 
same size had bf^en selected. Validity, on the other hand, is a quality of » 
a study th^t is not easily quantifiable; each cited study is subject to a 
particular set of threats to validity, and the results are not, therefore, 
strictly comparable. In order to reach a conclusion, therefore, we attempt 
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to determine the ertent to which various threats to each study's Validity 
are likely to have distorted the results. 

The single cited study with the greatest op^ortunit. co achieve valid 
conclusions iaas the Compensatory :ReaaLng Study. In that study, data collec- 
tion was under the control of the evaluator, whereas all other studies relied 
ci data collected for other purposes (i.e., annual local evaluations) with- 
out clear evidence of quality control. In the. CompensatOi./ heading Study, 
compensatory reading instructional effectiveness was evaluated by comparing 
pretest to post test changes in standardized reading achievement tests (MAT, 
STEP) between students receiving compensatory reading (CR) instruction and 
those not receiving compensatory reading instruction (NCR).; Five different 
analytical methods were employed (USOE, 1976b); however, all suffered from 
the various faults that arise when the students receiving one treatment are 
different frcm those receiving the other treatment: effects of the CR in- 
fc'truction are confounded by differences in the populaf''^ns . 

There are five particular problems with the Compensatory Reading Study 
of which readers should be aware. The implicationr of these problems are 
discussed in more detail In a companiou document (McLaughlin, Gilmartin, 
and Rossi, 19V7), First, analyaes were based on instructional group means; 
those means included different individuals at pretest and posttest adminis- 
trations; and the types of individuals who tended to miss one or the other 
of the tests were significantly lower achievers than those who were present 
for both tests. Thus, comparisons between compensatory and regular reading 
instructional groups were affected in unexplained ways by student mobility. 
Second, posttest scores tended to be much more variable among children with 
low pretest scores than among children with moderate or high scores. Thia 
"heteroscedasticity" is an important violation of the assumptions underlying 
the analyfial method used (analysis of covariance) . Third, there was a 
ceiling effect that operated mainly in the regular reading ir.structionrl 
groups: students who obtained perfect or nearly perfect scores, especially 
on the posttest, may actually have gaiaed much more t!ian was measurable 
using the tests. The impact of this effect was complex because of the ana- 
lyses used, and it may have caused he results either to be biased in 
favor of or against the compensatory reading instructional gr'-np Fourth, 
the well-documented fact that children with lower achie ^ei..ent t the time 
of the pretest) can be expected to learn at a slower rate than other children 
in the absence of a special treatment was rot considered. In fact, the 
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statistical comparisons carried out by ETS (Trismen et al., 1975) were aimed 
' purely, at the alternative criterion level H out of the seven levels listed 
abovei' \Subaequent analyses by USOE (USOE, 1976b) considered other alterna- 
tives. Finally, there was the problem of "differential regression to the 
mean", discussed in detail, for example, by Campbell and Rrlebacher (1970). 
To put It simply, tests do not measure perfectly; they all have some random 
error; and that error, by the nature of the evaluation design used, tends to 
make it appear that groups move farther apart from pretest to posttest. Be- 
cause the compensatory reading instructional groups started out with sub- 
stantially lower f«chievement scores, this means that, oeberia paribus, they 
would tend to appear further behind at the time of posttest. Readers should 
be cautioned in interpreting these five problems that they are more complex 
than these very brief descriptions might imply. There are arguments and 
counterarguments that must be taken into consideration before a final judg- 
ment of the validity of the study's results can be made. It is this author's 
opinion, however, that these and other problems seriously impair the utility 
of the study. 

In spite of these faults, the Compensatory Reading Study results rule 
out two of the answers to the question posed—the first and second. One 
could consider that the problems noted constitute not so much an indictment 
of the Compensatory Reading Study as a demonstration of the small difference 
between different criteria of success. In the Compensatory Reading Study, 
the difference in posttest score means between results indicating the third 
answer (closing the gap) and the fifth answer (falling further behind) was 
less than one-fifth of a standard deviation (for total "AT score in the 
fourth grade). While sufficiently large sample sizes can ensure reliability 
sufficient for the detection of a difference this small, there are numerous 
threats to /alidity that have effects larger than this. For example, th? 
effects of attrition might rot have been critical* in the search for large 
effects (85% of scudents with either pretest or posttest scores had both) , 
but in this study the differences in results that might be due to nonresponse 
bias were larger than the sizes of effects sough.. Therefore, an accounting 
of nonrebponse bias should have been included in the statistic.^l model used 
for analyzing program effectiveness. 

A point that should be emphasized c ic rning most of the other studies 
presented in Table 17 io the importance of the distorticns caused by reliance 
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on grade-equivalent scores for analyses. Detailed dlscus^l^ons of these dis- 
tortions are Included In McLaughlin, Gllmartln, and Rossi (1977) and need not 
be repeated here. To provide a brief Image of the problem, one should realize 
that If the average grade-equivalent gains reported for one group are greater 
than for another. It could bu that (I) the first group learned faster, or (2) 
the teacher of the first group focused on helping the faster learners In the 
group^ ot (3) the raw scores were translated Into grade-equivalents before 
averaging In the first group and after averaging In the second group, or (4) 
the two groups were at different stages of development. 

Due to the many methodological problems In addressing the question of 
general effectiveness of compensatory education through treatment /control^ 
comparisons. It Is questionable whether effectiveness can ever be validly 
assessed by this method^ It Is Important, however, to have some form of 
answer In order to guide decisions on allocation of national resources. Would 
education for disadvantaged children Improve with a large Increase In Title I 
appropriations? Would It deteriorate If Title I were abandoned? The answers 
to these policy -relevant que ^lons relate to effectiveness, but only Indirectly. 

Consider the expansion of Title I: one basis for expansion would be evi- 
dence not for general effectiveness but for the effectiveness of particular 
methods at a few sites, which would iieet the needs of greater numbers of chil- 
dren If their widespread dissemination and utilization could be subsidized. 
The Identification of particularly effective methods is discussed in the next 
section of this synthesis. Mother basis for expansion would be evidence that 
only a fraction of the target population was receiving services. This requires 
data, not on general effectiveness, but on participant selection procedures. A 
third basis for expansion would be evidence of a correl^'tion between cost-per- 
student and gains. This, again, does not require demonstration of the general 
effectiveness of the program. 

On the topic of gentral cost-effectiveness, results have been equivocal 
due primarily to limitations on the validity of ef fectivenewS measures. The 
cost-effectiveness study in the CRS reached the conclusion that "no relation- 
ships were uncovered between cost and program effectiveness. Hov/ever, this 
is not conclusive proof of no relationship. Our inability to find such a re- 
lationship may be the direct result of the liinitation^ la the data" (Flynn et 
al. , 1976, p. xix). In one study of California projects, Tallmadge (1973) 
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found no significant correlation between cost and effectiveness, and In 
another, Klesllng (1972) found a significant relation only when the expendi- 
tures were for particular methods. 

Consider the abandonment of Title I. First, we ^eed to differentiate 
between (real) abandonment of special efforts to Improve the achievement of 
educationally disadvantaged children in poverty areas and (apparent) abandon* 
ment of the current program in favor of a new effort. One basis for real 
abandonment would be the finding that nothing wrks; if not a single demon- 
stration of an effective method could be identified, the usefulness of the 
large effort would hav2 to be reconsidered. Again, general effectiveness is 
not the issue. In actuality » there are a number of different treatment methods 
that have proven potentially effective, at least m some settings. Another 
reason for real abandonment would bs a finding that the need no longer exists: 
many expenditures are one-time expenditures, and if the major need is for re- 
training or re-equipping teachers rather than for more teacher-student inter- 
action time, then it might be reasonable to expect the need for federal effort 
to decline. The evidence needed for this decision is related to services and 
aervice-erfectlvene.-js, not general effectiveness. Because there are still 
many achievers in low Income areas, the need remains; and the most gener- 
ally agreed upon category of service, providing more teaching time for each 
disadvantaged child, is clearly a recurring expenditure. 

The apparent abandonment of Title I in lavcr of a new effort, which is 
merely a method for shifting the administration of an effort to a new system 
of individuals, is one policy area for which general program ef f ectlvj^ness is 
relevant. If, within the budgetary limits,, there is a substantial discrepancy 
between the expected results of the progr^ and its actual effectiveness, and 
if the expectations are valid, then changes are warranted. (Whether ths ^ 
should be "formative" changes in which new methods are tried within the Title I 
structure or "summatlve\^' changes consisting of complete reorg.anization of the 
effort is a question beyond the scope of this synthesis.) 

So far, although incremental changes have been made in response to the 
lack of demonstrated effectiveness of Title I, no large-scale reorganizations 
(e. g. , eliminating the role of the state education agencies in program adminls- 
traticn) have been undertaken; rather, the validity of expectationo and of 
evaluation data have been questioned. 
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In sumary. Title I has not lived up to the expectations of the opti- 
mists of 1965, which has caused a hard look to be taken at the assumptions 
and objectives of the program and at the ways in which the performance of 
children in the program are measured. While the objectives have not changed 
greatly,* expectations have been lowered as the relative intractability of 
the problem has become apparent. Isolated instances of substantial impact 
have been- identified, and USOE has taken steps to disseminate the concepts 
and practices those instances to all school districts (e.g., the PIPs de- 
veloped by RMC). 

The assessment of the overall effectiveness of compensatory education, 
however, has yet to be accom-"' ^shed. The current studies by USOE (the Sus- 
taining Effects Study being carried out by SDC) and NIE can be expected to 
help answer the question of effectiveness. 

Variation in Effectiveness with Treatmen t 

Many different treatment methods have been suggested as crucial to suc- 
cessful compensatory education, based on an author's intuition or on hard 
experimental evidence or on something in between, because so Snany curricula 
have been constructed without sound research and development and have failed 
in practice, schools are justifiably skeptical about spending scarce resources 
to implement new methods. Thus, in examining the various methods proposed, we 
shall try to assess the validity of their support and their replication costs. 

There are four general problems to be dealt with before considering 
specific treatment methods: (1) the validity of supporting evidence, (2) 
particularly, the problem that several studies have focused only on positive 
instances, (3) the difficulty in specifying what the treatment methods actually 
consisted of, and (4) the problem of lack of focuS on compensator education. 

Generally, the conclusions reached by evaluators about the relative effec- 
tiveness o: afferent methods can be assumed to have greater validity than con- 
clusions about overall effectiveness for two reasons, but less validity for a. 
third raason. First, vhen comparisons are made, t^ey are made on more nearly 
equivalent groups. Whereas evaluation of overall effectiveness has employed 

* There has been a trend toward greater emphasis on intprvention in the 
earliest grades, however. 
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covparlson groups of more able students, alternative treatment methods are 
compared on a priori similar groups of students. For example, in the Compen- 
satory Reading Study, the comparison of compensatory instruction delivered 
separately or in a class combined with regular instruction was subject to 
fewer threats to validity than the overall comparison between compensatory 
and regular instruction for this reason. Second, the demand characteristics 
of the studies of overall program effectiveness, sponsored as they have been 
by the administrative agency responsible for program management, ensure that 
cbnclusions about program effectiveness will suffer loss of credibility, 
whether or not warranted. This loss^of credibility does not rtain to the 
relative comparisons of differeij^ treatment methods, however, because the 
agency does not stand to gain from any particular finding. 

On the other hand (the third reason) , with- the exception of the studies 
by Gordon and Koutrelakos (1971), McUughlin (1971), and G^'thrie et al. 
(1976) th» question of which treatment methods were most effective was of 
seccnua. / importance to some other goal of the study, and less care was taken 
in arrivin:5 at answers to this question than to others. The selection of 
which dimensions of treatment methods to investigate, and even in some case^ 
what evidence to accept was frequently subjective. For example, in qualifying 
their conclusions about relative treatment effectiveness, Hawkridge, Tallmadge, 
and Larsen (1968) cautioned that "investigator bias may have influenced the 
analysis of data from the programs." 

One serious source of misinterpretation may, in fact, invalidate all 
conclusions about *:he effectiveness of methods based on field observations 
rather than co itrolled experiments. Lip service is frequently paid to the 
concept that co -relation does not imply causality, but that caution is ignored 
* in many researcL or evaluation situations because the particular causal ex- 
planation offered or a correlation is more plausible than any of the alter- 
natives. The evaluation of compensatory education is not one of those situa- 
tions . 

First, different methods are usually applied to groups that, though 
similar, are not exactly equivalent. Therefore, whenever one metnod appears 
to be more closely rela^'>d to achievement gains than another, it is plausible 
to argue that this was because the students receiving the first method were 
likely to gain more in any case. As noted above, group nonequivalence is less 
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likely to distort comparisons between compensatory treatments than compari- 
sons between compensatory and regular treatments* 

Second, and this is particularly damaging, any method that is flexibly 
and sensitively applied as the need arises in a particular child is less 
llkfcly than other methods to appear to be corr^^lated with achievement. In 
the extreme case, when a method is applied in such flexible amounts that 
each child's needs are exactly equally met, then each child will achieve at 
the sane rate (except for random variation) and the correlation of the amount 
of the method and achievement gaihs will be zero! 

To take an example, suppose that there are 20 students in a particular 
classroom. A; and 

10 (fast learners) gain 1 month for every 20 instructional hours, 

10 (slow learners) gain 1 month for every 40 instructional hours, 

and the teacher spends 20 hours per month instructing the first group and 40 
hours instructing the second; that is, s/he responds in complete sensitivity 
and flexibility to students' needs. Then all 20 students will gain the same 
amount, and no relation between instructional time and gains will be observable. 
Suppose on the other hand, there is another identical classroom, B, with 10 
fast learners and 10 slow learners, end that within each class (A and B) 
Instructional time is forced to be the same for ^11 students, but that *in 
c-lassvoom A, 20 huurs per month are de/oted to the particular instruction 
while iu classroom B, 40 hours are devoted (because, say, an extra teacher is 
available). Then the average gain per nonth in classroom A will be 3/4 month 
and in classroom B will be 1-1/2 months. In this case, there is a perfect 
correlation between instructional time and gain. Thus, the likelihood of 
the effectiveness of a method's being observed is greatest when its applica- 
tion is inflexible: That is especially ironic for research on compensatory 
education. 

Turning now to the second of the four methodological problems, the ^ocus 
on positive instances, we must note that in some cases results have consisted 
of descriptions of effective programs without comparison with ineffective 
programs. Finding that a method is present in effective programs constitutes 
only very tentative evidence of its relation to effectiveness: one must then 
determine whether the method is also present in ineffective programs. This 
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problem Is especially important for making inferences from exemplary projects, 
such as the "It Works" searches, Follow Through planned variations, the PIPs 
effort, and the part of the Compensatory Reading Study that focused in-depth 
observation on five effective schools. The problem was recognized in the 
"It Works" searc^s, as Hawkridge, et al., (1968) carried out a supplementary 
comparison between selected projects and similar but unsuccessful projects. 
Conclusive evidence on the contribution of a particular method must include 
comparison between the method and a situation that is the sam^ except for 
absence of the method* 

The third problem concerns the specification of what the treatment methods 
actually consisted of. As pointed out in the Follow Through evaluations and 
in the LONGSTEP study of innovative education, the content of an implementation 
of a method cannot be validly inferred from some label assigned to it, but 
must depend on careful observation of the process. Individualized instruction, 
for example, can vary from careful diagnostic testing followed by highly struc- 
tured, relevOTit instruction sequences to a laissez-faire environment in which 
the student does what he or she phooses to do. Another problem is that the 
specification of some methods is multidimensional, such ^s in the "It Works" 

-I 

series, in PIPs, and in the Follow Through planned variations, so that it is 
difficult to determine which are the crucial components of effective methods. 
The careful research studies, such as those reviewed by Gordon and Koutrelakos 
(1971) , are ultimately of more value in addressing this question than compari- 
sons of vaguely specified methods in actual operation. Although one can ques- 
tion the generalizability (external validity) of results from controlled 
experiments, they at least provide the firm foundation of basic knowledge 
about the learning process upon which curricula can be developed and put ipto 
practice. 

The fourth problem concerns the general lack of focus on methodr specifi- 
cally designed for compensatory instruction as opposed to instruction in genet al* 
Nearly all the recommended strategies, such as careful planning, clear objec- 
tives, individual attention, and inservice training, apply to instruction for 
any students in any situation. Perhaps those who make the recommendations hav2 
felt that there was a general need to improve instruction, or perhaps there are 
no distinct treatments that help only disadvantaged children, but it would seem 
Important to isolate particular methods for dealing with the particular prob- 
lems faced by educationally disadvantaged children, if possible. The only 
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treatment method clearly recommended by several sources and clearly of partlcu- 
lar relevance to disadvantaged children is the fostering of support in the home 
for the child's learning. One possible reason for the lack of focus on the 
particular problems of the disadvantaged is the political connotation of 
pointing out those problems. The reaction to Arthur Jensen's recommendation 
that disadvantaged children should be^ taught by different methods because they 
have different learning capabilities should be sufficient to warn any politi- 
cally astute researcher to avoid th^s area carefully. It unfortunate for 
the disadvantaged children of today that such research into differential 
teaching methods has been tainted by the association with racism' it has inherited 
from genetic or heritability research. ^ 

Various treatment methods found effective in studies of compensatory educa- 
tion are shown in Table 18. Because of differences in terminology across dif- 
ferent studies, we have chosen tz define a set of categories of treatment 
method, and the names of the methods, require some clarification. The metlhod 
of "more teachers" refers to lowering the teacher: student ratio, possibly to 
the point of allowing individual instruction. It does not refer to the use of 
teacher aides or parents or peer tutors for instruction. Evidence presented 
by McLaughlin (1971) suggests that parental involvement in the classroom may 
primarily be for the purpose of helping the parent to help her/his own children 
to learn. Evidence from Follow Through (Anderson, 1977) suggests that peer 
tutoring may not be a particularly effective strategy. Gordon and Koutrelakos 
(1971) noted two peer tutoring projects in New York City that had mixed results. 

The term "more time" refers to the amount of relevant instruction received 
, in a specified time period, such as a year. Wiley and Harnischf eger (1974) 
have made a strong case for the importance of time as a determinant of achieve- 
ment. Data on time spent in a compensatory reading (or math) program ar^ 
particularly questionable, however, because of the necessity of careful re- 
cords of absences, the necessity of assuming students' attention to topic 
is closely related to a teacher's focus on the topic, and the necessity of 
recording time spent in related activit^s, such as a regular reading (or math) 
program. Moreover, the result found by Guthrie et al. (1976) and* by 
Coles et al. (1976) that there Is a positive relationship of instructional 
time and achievement only in the early grades suggests an artifactual expla- 
nation: PossiSly, more time was spent in the upper grades with just those 
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problem Is especially, important for making inferences from exemplary projectr§, 
such as the "It Works" searches. Follow through planned variations, <he PIPs 
effort, dkid the part of the* Compensatory Reading Study that focused in-depth 
observation on five effective schools. The problem was recognized in the 
"It Works" searches, as Hawkridge, et al/, (1968) carried out a supplementary 
comparison between selected projects and siniilar but unsuccessful projects. 
CpnclirSive evidence on the contributiojpi qf a particular method must inAude 
comparison between the method and a situation that > is the same except for 
absence of the method.^ ^ 

The third problem concerns the specification of what the treatment methods 
actually consisted of,. As pointed out in the follow Through evaluations and 
in the LONGSTEP study of innovative education, the extent 3^ an implementation 
of a method cannot be validly inferred from some label assigned to it, but 
must depend on careful obs^^rvation of the process. Individualized instruction, 
for example, can vary from careful diagnostic testing followed by highly struc- 
tured, relevant instruction sequences to a laissez-faire environment in which 
the student does what he or she chooses to do. Another problem is that the 
specification of some methods is multidimensional, such as in the "It Works 
series, in PIPs, and in the Follow Through planned variatibhs, so that it is 
difficult to determine which are the crucial components of effective methods. 
The careful research studies,^ such as those reviewed by Gordon and Koutrelakos 
('1971), are ultimately of more value in addressing this question than compari- 
sons of vaguely specified methods in actual operation. Although one can ques- 
tion the >generalizability (external validity) of results from controlled 
experiments, they at least provide the firm foundation of basic knowledge 
about the learning process upon which curricula can be developed and put into 
practice. 

The fourth problem concerns the general lack of focus on methods specifi- 
cally designed for compensatory instruction as opposed to instruction^in general. 
Nearly all the recommended strategies, such as careful planning, clear objec- 
tives, individual attention, and inservice training, apply to instruction for 
^ any students in any situation. Perhaps those who make the recommendations have 
felt that there was a general need to improve instruction, or perhaps there are 
no djlstinct treatments that help only disadvantaged children, but it would seem 
important to isolate particular methods for dealing with the particular prob- 
lems faced by educationally disadvantaged children, if possible. The only 
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treatment method clearly recommended by several sources and clearly of particu- 
lar relevance to disadvantaged children is the fostering of support in the home 
for the child's learning. One possible reason for the lack of focus on the 
particular problems of the disadvantaged is the political connotation of 
pointing out those problems. The reaction to Arthur Jensen's recommendation 
thkt (fllsadvantaged children should be taught by different methods because they 
hav€^ different learning capabilities should be sufficient' to warn any politi- 
cally astute researcher to avoid this area carefully. It is unfortunate for 
the disadvantaged children of today that such research into differential 
teaching methods has been tainted by the association with racism it has inherited 
from genetic or heritability research. 

Various treatment methods found effective in studies of compensatory educa- 
tion are shown in Tabie-14. Because of differences in terminology across dif- 
Werent studies, we have chosen t9 define a set of categories of treatment 
i|iethod, and the names of the methods require some clarification. The method 
\f "more teachers" refers to lowering the teacher : student ratio, possibly to 
the point of allowing individual instruction. It does not refer to the use of 
teWher aides or parents or peer tutors for instruction. Evidence presented 
by^McLaughlin (1971) suggests that parental involvement in the classroom may 
primarily be for the purpose of helping the parent to help her/his own children 
to learn. Evidence from Follow Through (Anderson, 1977) suggests that peer 
tutoring may not be a particularly effective strategy. Gordon and Koutrelakos 
(1971,) noted two peer tutoring projects in New York City that had mixed results. 

•^he term "more time" refers to the amount of rtlevant instruction received 
in a specified time period, such as a year. Wiley and Harnischf eger (1974) 
have made a strong case for the importance of time as a determinant of achieve- 
ment. \Data on time spent in a compensatory reading (or math) program are 
particularly questionable, however, because of the necessity of careful re- 
cords of absences, the necessity of assuming students' attention to a topic 
is closely related to a teacher's focus on the topic, and the necessity of 
recordinf. time spent in related activities, such as a regular reading (or t-ith) 
program. , Moreover, the result found by Guthrie et al. (1976) and by 
Coles et al. (1976) that there is a positive relationship of instructional 
time and achievement only in the early grades suggests an artifactual expla- 
nation: Possibly, more ti^e was spent in the upper grades with just those r 
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Methods Koported «• Effective for CoMponsetory Educetlon 
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LONCSTEP (1976) 
Guthria (1976) 
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students 'who were the most xn need of that time. As a result ^ according to 
the discussion at; the begi ining of this section, the negative results in the 
upper grades are questionable. 

There is pearly unanimous agreement th^t "directly relevant instruction" 
tha* attends to basic skills is crucial to achieve impact. This finding 
should be completely obvious, because it is the teaching of these basic skills 
tilat the schools are responsible for and that achievement tests directly 
assess. At many times,, however, eopecially in the 1960s, there has been an 
emphasis on other goals fo" the school's, such as building an individual's 
self-iiiiage, emphasizing cultural heritages, or promoting more "relevance to 
real life." In the late 1970s, there is a growing realization by the public 
of the ^jnplicatioris of these firdings and an increasingly stringent call for 
schools to teach "th basics." 

The ^ext coluim in the table, "indivirial prescription," refers to methods 
that ^re particularly tuned to the special nieeds of ihdivifii il students. It 
has been referred to a« individualized instruction and as indivxiual diagnosis. 
Although, individual prescription has been cited as effective i^ several tudies, 
other studies have found it to be Ineffective. In fact, with a given amount of 
time for instruction, ::he teachex who spends more time with the slower students 
is not likely tc increase the class average achievement gains. Logically, 
spending most timfe with the fastest learners should maximize class average 

gains. Studies oZ individual prescription are needed that are more sensitive 

] 

to individual performance gains ±han ar^- existing studies. 

T>e hext process in Table Ic refers to "clear objectives." Gordon and 
Routrelakos' (19''1) refer -ed to *uhis as the need for t< <ichers to have more 
planning time. This is a particularly difficult process to £^sess because many 
teachers have "clear objectives" that they are not easily abxe to translate 
Into behavxoral terms, either because of the multiplicity of different behaviors 
that they accept- as alternative indicatoi:s of learning or because they do not 
wish lo emphasize the differences in goals they set for different children by 
making them explicit. 1 ^may be that, where a teacher's ability^ to verbalize 
clear objectives is related to effective instruction, it is because s ^ing 
clear objectives is icself an indicator of understanding of the children* s 
learning process. On the other 'land, possessing clear objectives does provide 
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teachers with a basis for continuing assessment of their rate of progress 
toward their teaching goals. 

"Mixing students" refers to providing instruction to children with 
different ability levels within the same classroom setting. The results 
'^f the Compensatory Reading Study indicated that mixing students was related 
to significantly greater achievement g^'ns by compensatory students with no 
corresponding loss by noncompensatory students. Although these results were 
obtained by the same analyses that were evaluated as likely to he invalid for 
deciding whether compensatory instruction was generally effective, in the pre- 
sent case they are more nearly valid because the two groups being compared 
are more nearly alike at the time of pretest. The distortions due tc non- 
equivalence of trep^-ment groups are greatest when the groups are most differ- 
ent from each other. ^ 

"Parental involvement" refers to several different tactics, such as 
involvement in project planning, presence in classrooms, and learning to 
tea'^h in the home. Miltc^- McLaughlin (1971) distinguished between effec- 
tive and ineffective methods for parental Involvement: the former emphasize 
the content of involvement, whereas the latter emphasize the form of the in- 
volvement. For parents to learn how to help their children by being present 
in the classroom, they need to do more than clear erasers and tak^ attendance. 
However, it has been pointed out by Iliatt (1977) that if the parent is being 
counted upon as a classroom resource, greater instructional effectiveness is 
achieved by assigning menial, nonprofessional tasks to the parent. Thus, 
different reasons fo^ parental involvement (to educate the parent or to help 
the teacher) are in conflict. Results appear to indicate that teaching parents 
how to teadh their own children may be very important. However, if this can 
only be accomplished by involving parents directly in classroom teaching 
activities, compensation is neeaed for the children who a e therefore receiving 
less professional teaching expos .re. '^arhaps the use of curriculum materials 
that are foolproof for use by nonprofessionals is a solution. Such materials 
have not yet been developed. 

"Quality of administration" has been noted as an mportant contributor to 
effective programs. The r.uthors of the Compensatory Reading Study (Trismen, 
et al. , 1976) placed a great deal of emphasis on this factor, assigning it 
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greater importance than the quality of individual teachers. Although it 
is fairly obvious that systems generally benefit from good administration, 
the school setting is particularly dependent on good administration because , 
of the opportunities for cooperative maximi-ing of "productivity" as children 
carry their particular needs and resources from one teacher to the next. 

"Use of rewards" refers to explicit positive reinforcement of children 
for the achievement of learning goals. The use of rewards was a strate<ty 
characteristic of the more effective variations in the Follow Through planned 
variation study. This is distinct from the "human concern" that Gordon and 
Koutrelakos (1971) called for in compensatory education. It may be true tnat 
children need positive reinforcement in order not to become discouraged in 
school, and more specifically, the behaviorist point of view would suggest 
that the positive reinforcement should be contingent upon achievement gains. 
On the other hand, some research (e.g., Lepper, Greene, and Nisbett, 1973) 
suggests that external reward" may be harmful to learning when children al- 
ready possess intrinsic interest in .the tasks to be learned. More research 
into the level of motivation children have for learning basic skilU and how 
motivation relates to educational and economic disadvantage is needed. 

"Xnservice training" has been reported to be valuable when it is oriented 
to the particular methods to be used in a compensatory education project. 
New methods require more than superficial attention by teachers if they are 
to achieve the outcomes for which they are intended. One finding of the PIPs 
evaluation (btearns, 197/) was that the best implementations of packages 
occurred when local groups internalized and "re-cieated" the packaged methods 
rather than trying to follow written directions. 

Finally, a recently completed longitudinal study of "innovation" in the 
schools (Coles et al., 1976), although not directly aimed at compensatory 
education, found a somewhat negative correlation between the innovativeness 
of a school's program and the level of achievement of the students. 

As a part of the Compensatory Reading Study (not included in Table 18) , 
29 schools were selected from among the most effective and least effective 
schools, and various characteristics of the classrooms in these schools were 
observed (Trismen et al., 1976). The correlations of piocess variables with 
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effectiveness (measured as achievesient scores) varied across grc 
and 6* In second grade, the most salient correlates of effectivei 
inequality of teacher attention to different 'children, adult centered^ 
of the dassrooni, and positive classroom affect. In fourth grade, the most 
salient correlates were adult centeredness , but without the use of punitive 
control* In the tixth grade, the most salient ci -relates were student 
autonomy, lack of teacher warmth, and lack of positive classroom affect. 

An adequate suDwaary of all the research potentially relevant to compen- 
satory education is beyond the icope of this presentation. Rea-'.ers are 
referred to Gordon and Koutrelakos' synthesis (1971) for a more extensive 
coverage of the research up to that time. The present study focuses on the 
federal evaluation studies, and due to the quasi-experimental and correla- 
tional aature of those studies, the recommendations to be obtained from them 
should be considered tentative and in need of careful verification before 
widespread utilization — not just to refine and sharpen generalizations but 
also to determine whether those generalizations are i^sibly completely mis- 
leading. Many of the results have an aura of obviousness, such as the need 
for a lower teacher: student ratio, for more instructional time to be directed 
to basic skills, for a high quality of administration, and for sensitivity to 
individual students. Perhaps the most ur expected result is the recurrent 
finding that parental involvement is important; apparently, education is not 
an endeavor that schools can un' ^.rtake alonp . 

More refined informat, i about the. relative effectiveness of different 
treatment methods is clearly needed, and rigorously designed experimental, 
studies are the only means of obtaining that information. Such studies need 
not be large nor exa<rtly nationally representative; they must, however, rule 
out the alternative explanations that so often lead to ambiguous conclusions- 

Variation in Effectiveness among Types of Participants . 

This is really a double question: fitj^t, are there some characteristics 
of students that have been found to predict their success or failure in cont- 
pensatory education settings; and second, are there characteristics of certain 
individuals that call for use ot particular methods of compensatory education 
for them? It i., certainly the case that all children arc not alike and that 
there are many ways to learn basip skills, and to .suppose tnat compensator-^ 
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education by any method would be equally effective for all is absurd. Indeed, 
a key concept in rany of the successful projects identified by Hawkridge et 
al. (19^8) was sensitivity to individual problems and adaptive treatment for 
those problems. 

Identification of general traits that are cqrrelated with success or 
failure of compensatory education could be dangerous as well as useful. The 
danger lies in applying the generalization to all cases, which can be a s'-b- 
atitute for careful individual diagnosis. While in some cases it is defensible 
CO apply the generalization to individuals (e.g., blind children will of course 
-not be able > J learn from visual materials) , in most cases it clearly is not 
defensible (e.g., the generalizations, that girls learn language arts more 
quickly than boys ot that white learn more quickly than blacks). The useful- 
ness of generalizations lies at broader levels. First, if certain segments 
of the population are shown to benefit most from compensatory education, then 
resources should be allocated to treat all who need it in those segments, and 
research should be focused on new forms of compensatory education for other 
segments. As a hypothetical example, if it were found that known compensatory 
education methods produce dramatic gains in mathematics for girls who are be- 
hind in mathematics but not for boys', then the program could attain its 
greatest eftect on mathematics achievement by focusing instruction on girl's 
while supporting development of new methods of teaching boys. Second, com- 
parisons of different projects and their methods codld be made more nearly 
fair by taking into account differences 1 expect? tions of success between 
the treated populations. In the same hypothetical example given above, it 
one project were dealing with classes of 60% girls fJid another project 60% 
boys, this discrepancy might mask any greater eff ectiveneoS of the second 
project. 

In its bilingual education program and its aid to education for handi- 
capped children, the federal government has, l.i fact, identified particular 
populations and allocated resources stecif ically to them. Those allocations 
are in terms of needs, however, not in terms of expectation of success. In- 
• formation on expectations of success has yet to affect legislative direction 
of aid to particular segments of the population. One reason may be that lack 
of information on differential expectations of success. In none of the central 
studies reviewed was this question addressed, Although the Compensatory Reading 
Study collected data that would allow one to compare ef f ectiveress across 
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subpopulatlone. This lack of informatiou indicates the Implicit recognition 
by the federal government and, in particular, "^y the program administrators 
of the danger of such information becoming a basis ''•^r teachers to respond 
to children in terms of stereotypes. However, that danger is far outweighed 
by the potential, both short-teni and long-term, for improving the level of 
achievement of the nation's disadvantaged pupils. 

Five dimensions of variation among compensatory education participants 
appear worthy of investigation: (1) level of economic disadvantage, (2) 
ethnic group membership, (3) sex* (4) urban or rural context, and grade 
lev*»l of treatments In order to provide conclusive evidence concerning the 
relations of each of these with the effectiveness of compensatory education, 
carefully controlled studies would be necessary. Tentative hypotheses and 
directions for further research, however, could be developed from further 
analyses of the results of studies such as the Compensatory Reading Study. 

The level of economic disadvantage might be expected to relate to the 
effectiveness, for example, of home-oriented compensatory education methods. 
Educationally disadvantaged students from less impoverished home environments 
might (hypothetically) derive less benefit *from such programs than students 
from severely impoverished homes, suggesting that home-oriented programs be 
especially recommended for ^reas of most extreme poverty. (But we do not know 
that, because the appropriate study has still not been done.) 

Studies of differential xeaming patterns between blacks and whites have 
been controversial. Questions concerning the relative effectiveness of 
compensatory instruction vs. regular instruction for different ethnic groups 
are not nearly so controversial, however. They can be addressed by making 
comparisons of treatment and "control" groups within ethnic groups and then 
evaluating the results across etlinic groups. If it were founds for example, 
that ceteris paribus the effectiveness of known compensatory education methodj 
was greateiT for blacks than whites, then allocating greate* funds to regions 
with greater concentrations of disadvantaged blacks while supporting develop- 
ment of better methods for dealing with the needs of disadvantaged whites 
would increase the effectiveness of a compensatory education program such as 
Title I. (Again, we found no evidence relevant to this question in the studies 
reviewed • } 
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Similar results for the two sexes or for students in different types of 
conmunity settings (large city, small city, suburban, and rural) might be 
expected. Different types of children In different environments are, to a 
certain extent, likely to have correspondingly different deficiencies re- 
quiring particular remediation. The more exactly particular problems or 
special needs of categories of disadvantaged children are identified, the 
more effectively choices of allocation of Title I funds can be made. This 
is the sane principle that underlies the use of Individually prescribed 
instruction at the individual studen-t level. 

The dimension of grade level is unlike the other dimensions, primarily 
because every child passes through every grade level. Thus, the danger of 
stereotyped response is not as clearly present for this dimension; ir fact, 
data on the relative effectiveness of compensatory education at different 
grade levels have been reported in several studies (e.g., Wargo,et al.,. 1972; 
Gamel, et 41., 1975; Thomas and Pelavln, :976). Whether the youngest school 
children should receive the bulk of compensatory education efforts, as they 
do, relates to basic assumptions of the Title I program. If children who 
participate in compensatory education thereby become able to join the main- 
stream of instruction in the schools, then it is obvious that efforts should 
be heavily concentrated at the earliest stages. However, if joining the main- 
stream is not possible (and evidence suggests that it is not with present 
instructional strategies), then the goal of the program ought to be to ensure 
that all economically disadvantaged children leave school with the highest 
level of skills the schools can help them to attain; that implies a continued 
effort across all grade levels. Larson and Dlttman (1976) have discussed this 
problem. Two possible criteria for allocation across "grades are (1) relative 
needs and (2) expectations of gains in achievement to result, from compensatory 
instruction. Establishment of relative need is extremely difficult (e.g., 
there will be 10% of the children in the bottom decile at all grades) , because 
It must be based on an acceptable theory of normal growth in cognitive achieve- 
ment. Although Carroll (1974) has worked on such a model, more research is 
needed. Likewise, establishment of expected gains is problematic because of 
the lack of" an absolute scale on which normal growth in different grades can 
be compared. Data presented by ""homas and Pelavln (197 6) and cited by Larson 
and Dlttman (1976) would appo.ar to suggest that larger gains from compensatory 
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education occur at the higher grade levels. Thomas and Pelavin found grade 
equivalent gains of 1.0 to 1.1 in grades 1 through 6 and of 1.1 to 1.4 in 
grades 7 through 12. .Wargo, et al.> (1972) reported grade-equivalent gains 
from seven annual state Title I reports in 1969 and 1970 that averaged ,9 
for second graders, 1.0 for fourth graders, and l.L for sixth graders. Gamel 
et al. , (1975) reported grade^equivalent gains for 1971 through 1974 that 
ranged from about 1-0 to 1.2 for grades 1 through ,6 and from about 1.1 to 1.8 
In higher grades.* Results are probably artif actual, however, because they 
were based on grade-equivalent gains: for example, a child who moved up from 
the 20th percentile to the 30th percentile during the second grade may actually 
have appeared to learn at a rate of only 0.9 months of achievement per month 
of instruction (compared to the average, or 50th percentile, student), while 
a ninth grader who moved from the 20th to the 30th percentile in a year might 
appear to have leamed^at a 2.0 month-per-month rate. (This artifact is dis- 
cussed in McLaughlin, Gilmartin, and Rossi, 1977.) 

Summary 

Although little is known about the differential effectiveness of compen- 
satory education for different types' of childr^, such information would con- 
tribute to improving the effectiveness of compensatory education programs by 
focusing allocations of particular resources where they woul*be most effec- 
tive. It would also help to improve the validity of evaluations and to iden- 
tify the most critically needed research and development. 

Use of such information as an input to the further development of Title I 
policy must be made in the context of the multipurpose nature of this program: 
it may be that, although effectiveness in terms of achievement gains Is 
greatest for one segment of the population, program Impact in terms of 
truancy or violence reduction may be greatest in a different segment. To the 
extent that a consensus on the relative importance of different purposes of 
TJ.tle I can be reached, however, information on how most effectively to attain 
those purposes is relevant, including information on differential effectiveness 
across population segments* 

- I 

* Gains based on fewer than 300 actual students were not included. 
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Major Problems 



One cannot hope to Improve a system without first identifying its 
problems. The facilitative Impact of policy changes will depend on the 
extent to which those changes address the system's most serious problems. 
Therefore, in this section we reiterate the problems for Title I 
operation raised in the previous sections along with other problems pointed 
out in the studies reviewed, in order to provide whatever basis for policy 
planning can be distilled from federal evaluations of compensatory education 
to date. ° 

Because problems have been pointed out at various times throughout the 
last decade, it is necessary to discriminate between the transient and 
enduring prol^ems; the latter are the more important considerations for 
future planning. Also, rather than leaving the reader to infer that problems 
not mentioned have not occurred, we shall try to U 3t potential problems that 
have-apparently not occurred. Finally, in order to guide i=?arch for solu- 
tions, we have attempted to point out relations among the problems (e.g., 
"A" is a problem only so long as "B" is a problems) . 

Three studies that have not been mentioned in previous sections because 
their results do not add to our knowledge abotit participant characteristics, 
treatment delivery, or evaluation reporting provide the clearest statements 
of some of the problems in Title I operations: the Washington Research 
Project report (Martin and McClure, 1969); i-he Planar reports (1972; 1973); 
and a historical study of the USOE 'role in Title I evaluation during the 
first five years (Milbrey McLaughlin, 1975). In addition, the reports by 
Wargo et al. (1972), Gamel et al. (1975), and GAO (1975) have focused on 
identification of particular problems, however, in any of the studies 
reviewed . 

Administrative Problems 

1. Misuse of fun ds. Especially in the initial yea of Title I, and 
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continuing through the first few years, there were numerous^ instances of 
use of f^nds for purposes other than those intended. The Washington 
Research Project report (Martin and^McClure, 1969) named and described many 
such cases, and the DKEW Audit Agency identified many examples of noncomr 
pliance each year. Clear cases were uncovered of use of funds eith r to pur- 
chase resources that were used by nondisadvantaged pupils or to purchase 
resources for disadvantaged pupils that other district funds purchased 
for nondisadvantaged students. According to the Planar study, however.^ 
many of the audit exceptions were nonsubstantive violations due to inconsis- 
tent signals from USOE and the Audit Agency.- Of a total of $174 million in 
audit exceptions rluce 1965, only about $8 million were sustained on review, 
and only about $700,000 has been returned to the treasury (NACEDC, 1976). 
In recent years, federal administrators report only r^ra instances of clear 
misuse of funds; although audit exceptions continue to occur, they are small 
or nonsubstantive. This is true in spite ^of the fact that there has been 
only very mild federal action taken in cases of misuse of funds (otjher than 
generally to make regulations tighter for all). Rather than reque^ return 
of funds to the treasury, the NACEDC has recommended that they be spent to 
help disadvantaged children in the district found to be not in compliance. 

Technical assistance would be provided to help €he district comply. 

t 

2. Lack of consistent federal regulations and guidelines . The Planar 
reports carefully examined the federal administration of Title I in 1972 
and found not only hundreds of instances of vague and indeterminate lan- 
guage in the regulations and guidelines* but also a la&k^^f orderly process 
in the development of regulations and a la of awareness of reality in the 
requests made of local dsitricts. In Septeuner 1976, USOE published a draft 
of new regulations for Title I and invited comments. At this "time, it is 
not clear whether these regulations are satisfactory improvements on prior 
regulations. 

3. Invalid evaluations . Title I broke new ground lot only^in sending 
substantial federal aid into most school districts across the c untry but 



★Regulations are formal exteftsions of the law, and gusLdelines are admia- 
istrativs suggestions for procedures. Both are published by USOE, and 
at times the practical distinction between them has been lost. 
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also in requiring each local project to conduct annual evaluations of its 
use of the money. As the companion document on evaluation methodology 
(McLaughlin, Gilmartin, and Rossi, 1977) shows, valid evaluation of compen- 
satory education's impact on children is extremely complex, requiring not 
only rigorous data collection but also testing of numer/ovis subsidiary 
assumptions and performing analyses not included in standard statistical 
texts. As discussed in that methodological presentation, the only valid ^ 
comparisons of Title I treatment groups with control groups have been the 
rare cases of randomly' assigned treatment and control pupils. Absolute 
criteria for successful impact have not yet been developed. 

As Wargo et al. (1972^ and Ganel et al. (1975) pointed out, the existing 
reports cannot be aggregated to produce a national summary. USOE has taken 
steps to solve at least part of the evaluation problem, the need to have 
well-specified, comparable evaluations carried out at all project sites, so 
that results can be aggregated to form an overall assessment of^itle I 
Impact. -USOE contracted with RMC Research Corporation in 1974 to develop and 
package evaluation data collection and analysis, models to be used by districts 
throughout the country and then established regional technical assistance 
centers in 1976 at which evaluation experts would deal with the problems of 
Implementing the RMC models. Although substantial problems of validity 
remain, a significant step has been taken to provide meaningful information 
from local Title I evaluations. 

4. Lack of a strategy for developing effective method s. When the ESEA 
of 1965 was passed, it was expected that professional educators would be ab ^ 
to translate the additional funds flowing - schools into effective 

compensatory education practices- Therefor- t;.. law did not include a strong 
research and development component, and .t Vrls £ .ir^til 1968 that a project was 
set up to identify- successful, pra :tices in existing «rbj*>cts (Hawkridge 
et ai, 1968). At about the same f une. ;he Follow Throiigii Planned Variation 
stipdy was initiated in order to compare altei .atiye methods for achieving 
lasting effects of earl> childhood basic skills instruction! However, 
neither effort developed into -a comprehensive program to investigate the 
most effectivenconfigurations of alternative methods.. Other efforts, the 
PIPS development arid NIE's Basle Skills Division's research program, have 
also not been developed as comprehensive, systematic efforts to deterraine 
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the most effective methods* r. 

\ 

WelV^-* and Banet (1975) have suggested that a 10- to 12-year research 
an<J development effort is necessary in order to p(:oduce a curriculum that 
Is clearly successful for a broad range of children. Suc;h a systematic R&D 
effort may well be necessary; beckuse less rigorous and thorough attempts 
have yet to. succeed. While it would be costly, such an effort would have ^ 
the potential to dramatically improve the overall Impact of compensatory 
education. A clear plan specifying the concrete objectives and the methods 
to be used In such an effort As needed* 

5. Lack of parental involvement . Although professional educators have 
been enthusiastic aboui participatioVi in the Title I program, they have 
generally been less enthusiastic about sharing their role with parents. 
Although a case can be made that professional educators are the most com- 
petent Individuals to design and implement educa'tl-on programs, parents in 
fact play a critical role in the education of the^r children, as pointed 
out by Milbrey McLaughlin (1971), aiong otHers. The few coiipensatory 
education projects that have involved parents in teaching their own children 
have .generally been among the most successful. There is clearly a need for 
more<extensive development of guidelines for the irvolvement of parents, 
based on a well-th6ught-out rationale for the most effective ways of thett 
contributing to compensatory education. That rationale will need to ihvolve 
an increased understanding of the actual processes that result in the strong v 
correlation in society between parents' . socioeconomic status and children's 
early academic achievement. . ,. » "! • 

6. L,^ck of knowledge about Individual d ifferences in the processes 
bv which children acquire cognitive skills . Statements like 'If we/ can 
send a man to the moon,- why can't we teach our children to read?" are 
commor.Aace. They display a fundamental underestimation of the complexity 
of the human mind. Although a trip to the moon is an extremely complex 
undertak;Lng, it is basedL on known ipathlmattcal formulas and physical con- 
structions. Analogous theoretical bases for human achievement are far more 
complex, and although a great" deal is already known abo^ut the teaching of 
basic. skills » ^far greater amount remains to be learned. Existing com- 
pensatory education practices are merely heuristic, :.ftistic guesses con- • 
' ceming what will work, and as^pointed out in an ear lie ? secj^ion, valid 
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data on the relative effectiveness of different compensatory education 
inethodls* are virtually nonexistent. 

The types of questions that^must be answered Include at least the 
following: What basic component skills constitute reading ability, for 
example? What alternative combinations of component skills can achieve 
the same performance? What are the processes by which basic component 
skills 'are acquired? Which component skills are easy or difficult to 
acqxilr^? What is the range of individual differences on the potential 
for .acquiring* basic component skills, and what are the correlates of those 
' * ' Individual differences? What external events lead to the Improvement of 

basic component skills? What role does motivation play in the acquisition 
of various skills? What external events affect motivation to learn? Wh^t 
are the barriers that inhibit learning to read? Wiat ^re the causes of 
^ these barriers? What types of learning processes occur in children as a result 
of interaction with teachers? To each of these questions and to many related 
^ quitions, the iliterature in psychology, sociology, and education offer 
a plethora of preliminary answers. Perhaps a €horough review of the 
research literature ''would move a long way in the direction of prt^ducticn 
of knowledge necessary to develop effective compensatory education. Such 
- a jevi§w was not included in any of the federal studies reviewed, although 
' the Compensatory Reading Study included a narrow literature review (Farr 
et al,- 1974),' 

7/ Lack|of effective compensatory instructional methods . This pro^ 
lem which we'argue^is a consequence of not havin^g solved t..e preceding 
{MToblein, is the most crucial of all. If we had effective methods imple- 
^mentedv*l^ossithe country, then the achievement of disadvantaged children 
would-be rising as intended by the originators of Title I, and the problems 
-that remained! would be. of secondary importance. The Follow Through study 
and the PIPs ^vaiuatioit^were intended to. provide demonstrations of methods 
• 'that worked, \\iX. jtreir^esults were not positive. 

The argument that some methods have really been effective and that the 
fault lies in t;he imprecision of measurement has been freiiuently voiced 
and was . tsciused in the section of general ef f ectiyten^ss , above, ^t io 
certainly trul that, after the first and second gr4<es , • individual /differ- 
ences in achi^vf-ment among pupils in a single grade greatly exceed the 
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an»v-\t that is learned during a single year on the a\j^ge. ' As pointed out 
by Tallmadge and Horst (19)7f , the potency of instructiojT:hat would bring 
pupils performing at the \5th percentile up to, say, the 4pth percentile 
would have to M ^much greater than the*potency of normal instruction. How- j 
ever, that level of potency is what was desired by t^e proponents oi^ compen- / 
jatory education, and demonstrating a method for achievins it ev'en though at 
itorc ''han moderate expense would provide the rationale for increasing the 
compensatory education effort to meet the special needs of all educationally 
disadvantaged children in poverty areks. 

8. Special educational needs outside of low-income areas . Not only are 
there many children from modetate-income families who have need for compen- 
satory education, but also th^ra are many children from low- income families 
who reside in communities wh(ise general economic level excludes them from 
Title I particip- "on. Although there ia a correlation between educational 
and e<|ot|omic disadvantage, and although a large proportion of thfe low-income 
familie^ are clustered in low-incone areas, limiting the aid to low-income 
areas ^eludes millions of childrei^ from the program who might benefit froA 
it. In fact, too rigid an interpretation of the comparability regulations 
may inhibit school districts and states from providing other aid to these 
millions for fear of losing the much needed Title T assistance. 

The problem is not easily solved. For one thing,/ providing a program 
fpr just a few children in a school is much less efficient than^ providing a 
program for many children; fundir based on the number of economically dis- 
advantaged childrenSserved would not add up to the'minlmum needed to imple- 
ment any kind of effective project in ma^ schools serving mainly affluent 
children. The solution has been proposed of changing the funding formula so 
.that all educationally disadvantaged cl -dren, regardless of economic jack- 
ground, would have an equal share of the funds. The technical problems 
associated with that solution iU the area of assessing educational . diMdvai>- 
tage (e.g., are the same criteria applied throughout che country?) ar^ 
substantial. 

nonexistent Problems 

As a balancing note in this section, it seems appropr late , to point out 
several problems that might have occurred in Title I, ]?ut do not seem to have 
actually occui:r^. First, there is no lack of manpower in th^" teaching fiel<? 
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to catry out Instruction designed for individual pupils or small groups. 
Thare la. in fact, a large surplus of ^dividuals trained as teachers, and « 
the- large proportion of Title I funds spent on teachers and teacher aides 
nay reflect attenpta to tap this labor reserve. 

Second, there appears to be little difficulty in identifying low^' 
income areas (at least approximately) and identifyi-ng children who are 
lagging behind their peers in the acquis iCfon of basic skills. There is 
no question about the identification of need, although some argue that the 
priority of needs to receive federal attention may be misplaced. (For 
example, there havi recently been suggestions for including aid to educa- 
tionally disadvantaged childre.n In high- income areas). 

Third, local school districts have not been hesitant to participate 
in the Title I system. The additional focus of society's resources onto 
education is welcomed by educators, and the insistence that those resources 
be used to help the most needy students has not met substantial ,ppposition, 
although cases of misuse of funds were identified in the early years. 

Fourth, and finally, there has been no lack of ideas for ways to ^ 
implement compensator^ 'educatioif:'' The breadth of ideas shown in the sec- 
tion on methods, above, indicates the fertility of the minds of professional 
educators. What needs to be done is a careful sorting of the essential 
effective components from the rest. 
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This report focused on the results, of approxlnately twenty central' studies 
of .conpensatory education completed before 1977 and attempted to present the 
aajor results of those studies a^ they relate ^o Important policy questions 
for Title I. As the authors of those studies have repeatedly pointed out^ 
there are^ severe limitations on the validity of conclusl^ that can he-r^ched 
using politically and economically feasibly and available evaluation methods. 
Therefore, all the results presented should be vl^ed as estimates awaiting 
verification* ^ . 

The results were presented first as they relate ^to the major tasks of 
Title I; participant selection, treatment delivery, and evaluation reporting. 
Then the results concerning program effectiveness were reviewed: overall 
effectiveness, variation in ef fectivenesf as a function of treatment method, 
and variation in effectiveness across types of participants. Finally, a series 
of eight major problems in, the implementation of compenf^atory education were 
identified and briefly discussed. ' ^ 

The primary concern in the area of participant selection is whether appro- 
priate children are participating. The data that are available indicate that 
the 5 million participants each year tend to be those with educational and 
economic disadvantage. How perfectly participation matches n^eds cannot be 
ascertained because of inevitable errors in measurements of needs performed 
in evaluation studies. There are undoubtedly latge numbers of children who 
would benefit from compensatory education who are excluded from the program, 
however ,o because they do not reside in "low^income areas/' Reaching these ' 
children would require substantive changes In the law. 

^e design of compensatory education treatment methods has been a very 
'decentralised effort, although federal efforts have recently increased (.e.g. 
PlPs and the National Diffusion Network). As a result, many different 



r 

treatftents have been tried. Forty projects that have been'judged exemplary 
are briefly described in che text.' The primary objective of moat compen- ^ 
satory education projects has been to improve reading skills in the elementary 
» grades, although substantial efforts in mathematics and other basic skills 
h«^ve beta Included. Noninstructional objectives, although prevalent in the 
early years of the prograits, have become only a small part of the .Titlp I' 
effort in recent years. 

The "agents" involved in providing compensatory education include 
teachers, teacher aides, parents, remedial specialists, peer tutors, and 
counselors. Compensatory instruction has taken place in regular classrooms, 
special classrooms, laboratories, homes, and field trips. - Instruction has * 
been teacher-centered, child-center*!', structured, unstructured; in large 
groups, in smalls groups, antt individual. Activities have included regular 
lessons, kits of special lessons, audiovisual experiences, games, toys, 
dramatics, tutoring, counseling, and parent training. These have been 
employed in many combinations as schools have, tried to meet the needs^f ^ 
their educationally disadvantaged pupils. 

Evaluation reporting has proven to Jje much more difficult than was 
expected =?t the outset of Title I. Many of the problems for compensatory 
education are discussed in a companion document (McLaughlin, Gilmartin, 
Rossi,* 1977), aSd this topic was only briefly discussed in this synthesis. 
With the new emphasis on v^lid evaluations derived from the Education Amend- 
ments of 1974 (P.L. 93-380,|l51), USOE ef forts» are currently directed toward 
in^roving evaluation by providing technical assistance to local districts in 
their efforts to carry out evaluations. 

The infQimation on overall program effectiveness, as measured In terms 
of Increased achievement gains by program participants, has been less than 
adequate to determine how effective the program is. Of the studies reviewed 
(which di^ not include the current Sustaining Effects Study and the NIE 
evaluation of compensator? education) , only the Compensatory Reading Study 
carried out by the Educatio^l Testing Service had the potential for producing 
valid conclusions concerning achievement. Due to several severe problems with 
the Interpretation of the data from that^study, however, its conclusions can- 
not be accepted as definitive. ' ^ 
■ If we "were to disregard the threats to the validity of the various reports 
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and accept tbelr conclusions at face value, they have tended to be "hopeful." 
Huch of the available data (which we believe to be questionable) supports the 
conclusion that Title I participants achieve at a.ratecqpparable to nbn- 
disadvantaged "children, which leaves thent a constant distance behind the 
population average, but is a faster rate> than disadvantaged children in 
general attainV 

Concerning variation in effectivtoiess among treatment methods, the data 
also leave room for methodological Ijnprovement . However, there have been 
recurrent findings that should be noted. In general, treatment methods 
rec^nmaended for compensatory education are very -similar to generally good 
educational methods (e.g., smaller student: teacher ratios, clear oB^ectivss, 
directly relevant instruction, go,od school administration). One exception 
to this is the emerging consensus on the importance of Increasing parental 
invoT.vement as an Affective way of treating educationally disadvantaged 
children in Title I schools. 

Concerning variation in effectiveness across population groups, 1-ttle 
information has been reported. One apparent variation is that paKtlclpating 
students in higher grades tend to show larger gains in grade-equivaleAt units 
than participants In earlier grades. This result is almost surely an arti- 
fact of the use of grade-equivalent scores in analyses of achievement. 

Finally, the major problems listed for Title'I, some of whlcb are now 
apparently solved but others of which continue, Include misuse of funds, 
lack*of consistent federal regulations and guidelines, invalid evaluations, 
laclc of parental Involvement, lack of effective treatment methods, lack of 
a strategy for developing effective treatment methods, lack of knowledge 
about individual dilferences in the processes by which children acquire 
cognitive skills, and the exclusion of disadvantaged children not in low-^ 
income '^reas. Of these, the misuse of funds is the one which appears to 
have been elli^ted. The adequacy of ffderal regulations » the validity of 
evaluations, the involvement of parents, 'and inclusion of all disadvantaged 
chUdren could conceivably be ensured through appropriate congrasaional and 
administrative actions. The other three problems, which concern the develop- 
nent of effective treatment methods, could be expect ed^gradually to yield to 
the Implementation of rigorous, experimental designs for research ahd develop 
ment, but are likely to remain as severe limits to Ti%le I effectiveness with 
out such efforts. 
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